The problem SilentTalks solves

The project is for making better communication between dumb people and those who don't understand Sign Language. American Sign Language is a visual language. The shape, placement, and movement of the hands, as well as facial expressions and body movements, all play important parts in conveying information. Fingerspelling is part of ASL and is used to spell out English words. In the fingerspelled alphabet, each letter corresponds to a distinct handshape. Fingerspelling is often used for proper names or to indicate the English word for something. We are using Convolutional Neural Networks to predict the sign language letter and combine those predicted letters to form the sentence to be conveyed. The message will then be converted from text to speech using Python's built-in support. The input will be provided in real-time using the webcam.

Challenges we ran into

Background noise makes the predictions difficult