The problem Gesture Talk solves

About 5% of the world population is deaf and dumb. These specially abled people face the problem of loneliness since there exists a language barrier between the normal people & the specially abled one. The normal people find it quite difficult to learn and communicate with them because learning sign language is not an easy task.

What we plan to do is create an app - Gesture Talk - which will in real-time recognise the sign language communication being performed by the person, and will present before you whatever they're talking. In this way, user will be able to understand. The real-time video feed analysis and prediction leads to ease of user experience since there's no lag and the easy to use UI will be quite accessible to everyone from a 7 y/o kid to a 70 y/o senior citizen.

Challenges we ran into

The main challenge was real-time feed of data and then analysing it frame by frame and then doing computations over it and send it to our ML model, which was quite a tedious task.