The problem Open-Source Learning Assistant AR solves

1. This AR APP(Open-Source Learning Assistant AR ) will be useful to anyone who is interested to learn about Open-Source Technologies and Linux kernel and mainly useful to children by teaching them these complex concepts in a fun way using Immersive Technologies like Augmented Reality(AR).

2. One can type some commands on the terminal which gets augmented into reality and can see what those commands do in AR.

3. Our app presents users with a list of commands from which he can choose and learn the functionality of that command in a Terminal presented to him in Augmented Reality. If that command does not exist in the list of commands then our app redirect him to another scene where using Unity Web View feature one can browse about that command on the web.

4. We will even be analyzing the way the user is using the APP, by storing the usage time on various sections, no of taps on the screen which will tell whether the user is really learning or not and many more parameters, using all this data our ML model will analyze this and can predict the outcomes like with what pace user is learning, how much one has learnt, how much is one able to understand and much more.

Challenges we ran into

During the entire course of development of this APP we encountered many issues as we had first built this project for Windows, we programmed everything according to keyboard input and after that for implementing AR features, we had to build it for Android so we encountered issues when converting that keyboard input code,... into Touch input and taking input from Onscreen or Touch Keyboard of Android.

We got many build issue as always happens in development. Mainly the issues were related to Gradle and some errors when we had set up the AR SDKs in Unity.

We faced many issues while integrating this with Flutter APP also using Flutter Unity integration plugin.