C

Complete Immersive Education using XR

We revolutionize the way teaching works at classrooms, labs, homes and coaching institute by introducing XR (Extended realities) in the mix.

The problem Complete Immersive Education using XR solves

The basic problems it solves are:
To make education system in India more interactive and engaging for students, teachers as well as working professionals.

Our Product is a cross platform(Android & iOS) application that will bring immersive experience to the users. User can then observe, experience and interact(using gestures and motions) in a solo or with peers/instructors in a real time cloud shared environment.

The following use cases have been implemented:

1)AR/VR Marker detection to make any book into a fun , animated , immersive experience by showing related interactable models with sounds. Markers can also display videos. This keeps the user engaged and increases immersion in the learning process.
2) Cylindrical object detection can help place instructions and increase the effectiveness and rate of learning to operate .

  1. Using Gaze to input in VR we can also create better accessibility handsfree to physically handicapped people or just increase the immersiveness in general.
    4)We have also created a virtual lab that can be used by hand detection , capturing various gestures like grab,pick , click etc to interact. A virtual chemistry lab can be a good use case for it.
    5)Hand gesture recognition is also implemented by us in painting using the hand in VR.
    6)A multiplayer AR/MR experience is one of our leading feature as it revolutionize the way lectures are presented , students can now view in realtime what teachers are teaching along with a speech to text system on their disposal that can be used to put in commands, translate the speech , ask questions etc . This tech can be further implemented to teach complicated workings of machinery , surgery etc.

Challenges we ran into

The biggest challenge was to implement the hand detection and multiplayer AR experience as the tech for AR/VR is fairly new and lacks any kind of useful documentation from the makers hence it is was very hard to figure out the working.

Discussion