Beacon
See the World, Navigate with Confidence: Your AR Companion for Safe, Independent Journey
Created on 10th November 2024
•
Beacon
See the World, Navigate with Confidence: Your AR Companion for Safe, Independent Journey
The problem Beacon solves
This AR-powered mobile app addresses the challenge of safe and independent navigation for visually impaired individuals, providing real-time support to help them confidently move through both outdoor and indoor environments. By combining object detection, voice guidance, and community assistance, the app reduces the need for constant physical assistance, enabling users to navigate new and familiar spaces with greater autonomy and safety. This also helps alleviate the anxiety and potential risks of navigating busy streets, public places, and complex indoor areas, allowing users to enjoy more freedom and self-reliance in their daily lives.
Challenges we ran into
- While working on voice commands and adding the master command "hey beacon", we encountered a major problem that was the flutterspeech to text library does not have an inbuilt wake-up command. So we had to use an external service from Picovoice. The problem was that the model was having problem in getting downloaded.
2.Google ML kit had basic classification tehcniques not suitable for our app. Also, the TFLite was not working properply. We could not overcome that yet but we can use another model which has some better classification.
Tracks Applied (1)