S

Sign-Speak

Sign language is the noblest gift God has given to deaf people and making it readable by everyone people is our project.

S

Sign-Speak

Sign language is the noblest gift God has given to deaf people and making it readable by everyone people is our project.

The problem Sign-Speak solves

Problem

Everybody can't understand sign language and there is no other way for deaf people to communicate. So, our motive is to create a cross-platform mobile application that will help deaf people to communicate with normal people. A Lot of research has been already done on this topic but nothing is implemented in real life.
So here is our attempt to solve this problem...
We have created a mobile application that will real-time convert sign language to speech. .Also, we have kept the UI of the app simple so that it is accessible and handy to everyone.

What we have Achieved

We were able to complete the app i.e. The flutter app is capable to convert real-time image stream to speech but our Machine Learning model is doing its best but is not that accurate but we really hope this solution will help the people in need.

Challenges we ran into

  1. Learning sign language was new and difficult for us and after this experience, we decided to add a feature in our app in the future where users will be able to learn sign language using our app with AR/VR,
  2. Training Machine learning model to recognize gestures was very hectic as there were many gestures that were similar.

Discussion