The basic problems it solves are:
To make education system in India more interactive and engaging for students, teachers as well as working professionals.
Our Product is a cross platform(Android & iOS) application that will bring immersive experience to the users. User can then observe, experience and interact(using gestures and motions) in a solo or with peers/instructors in a real time cloud shared environment.
The following use cases have been implemented:
1)AR/VR Marker detection to make any book into a fun , animated , immersive experience by showing related interactable models with sounds. Markers can also display videos. This keeps the user engaged and increases immersion in the learning process.
2) Cylindrical object detection can help place instructions and increase the effectiveness and rate of learning to operate .
The biggest challenge was to implement the hand detection and multiplayer AR experience as the tech for AR/VR is fairly new and lacks any kind of useful documentation from the makers hence it is was very hard to figure out the working.
Technologies used
Discussion