D

Digital Eyes

AI based narration camera for the visually impaired.

D

Digital Eyes

AI based narration camera for the visually impaired.

The problem Digital Eyes solves

Digital Eyes is a mobile application that utilizes machine learning to perform image recognition in real-time from the user's mobile phone camera. The system detects objects that are in front of a user. The application is designed to be used when the user is walking around, either outdoors or indoors.

Users can now walk around with added awareness of the objects and people around them. This increases convienence, minimizes safety risks, and reduces the disability inequality gap. Audio feature ensures that users can adequately understand objects in “sight” and anytime a new object appears, audio reminders are played.

Core Features

Control via voice commands, to start/stop operation
Text-to-speech user interface read outs for those who can not use the display-based UI
Real-time image recognition with audio reminders of objects in the environment
Warnings of impeding danger

Challenges we ran into

The main challenges we ran into had to do with integrating the back end in Python to a front-end developed in Flutter for easy launch of a mobile app. In addition, improving the performance of the application for mobile devices was difficult as the algorithm was not designed for low-power edge mobile devices.

Discussion