Hear Me Out
Helping You Hear What You Can’t See
The problem Hear Me Out solves
Blind and visually impaired individuals often struggle with navigating public environments due to an inability to see signs, obstacles, or important textual information like directions, warnings, and labels. Existing tools are often expensive, require constant internet access, or don’t offer real-time assistance.
How It Helps
- Real-Time Awareness: Converts visual information into speech instantly, allowing users to understand their surroundings as they move.
- Offline and Lightweight: Works entirely on-device without the need for internet, making it reliable and usable anywhere—even in remote areas.
- Affordable and Accessible: Uses widely available smartphones and compact cameras, reducing cost and increasing accessibility for everyday use.
- Safer Travel: Helps users detect key objects and read signs or warnings, reducing the risk of accidents or confusion in unfamiliar environments.
This solution empowers blind individuals to move through the world with greater confidence, independence, and safety.
Challenges we ran into
One of the main challenges we faced was loading and running AI models efficiently on mobile devices. Since smartphones have limited processing power and memory compared to desktops, optimizing the models to work smoothly in real-time without overheating or lag was difficult. We had to experiment with lighter models like EfficientDet-Lite and use frameworks such as TensorFlow Lite to make on-device inference possible while maintaining acceptable performance and accuracy.
Technologies used