Keyo
Bringing eyes to voices
The problem Keyo solves
Visually impaired individuals and people with memory-related conditions like Alzheimer’s often struggle with everyday tasks such as finding personal items or understanding their immediate surroundings. This leads to frustration, dependence on caregivers, and reduced independence. Existing solutions often rely on smartphones, internet connectivity, or wearable devices, which can be expensive, complex, or inaccessible for many users — especially the elderly. Moreover, privacy is a major concern when visual data is sent to the cloud. Our system solves these issues by using voice commands and existing CCTV-style cameras to provide real-time object location guidance and contextual scene descriptions. It works offline, requires no tech literacy, and ensures privacy by keeping data local and blurring faces — making daily life more accessible, dignified, and secure for users.
Challenges we ran into
- Depth estimation using 2D coordinates i.e. estimating z-axis values.
- Object size and relative direction calculations
- Web Socket based video streaming
Tracks Applied (1)