Our app uses AR-based image and plane detection to augment 3D models over an image (that can be a book or any plane image). Here we have used a universal marker to demonstrate the prototype. The same process will be used to view them over our academic textbooks such as NCERTs. It turns the 2D diagrams of textbooks into 3D visualizations and simulations where one can even interact with the diagrams by using touch gestures such as drag, zoom, and rotate according to their convenience. We have tried to make 3D models that are self-explanatory and easy to understand. We have also integrated animations in some 3D models (like engines) to explain their working more accurately. We also have VR support for some topics like the solar system, which will provide an extremely immersive learning experience and increase the interest of the students.
We never built a full-fledged Android app using Unity 3D so this was the first time we were able to make it after many trials and errors. Also, while making the VR part the textures of our objects and other visuals were gone and we were in a panic because they were not even glowing like how we intended them to. Another challenge was working with 3D modeling and adding animations to the 3D models, we found this difficult because none of us had any experience in working with 3D animations that well. But we didn't give up and kept on learning and we were able to integrate lots of animations in our 3D models.
Discussion