SIGN LANGUAGE TO TEXT/SPEECH
To create a computer software and train a model using cnn which takes an image of hand gesture of ASL and shows the output of the particular sign language in text format and convert audioas well.
Created on 23rd March 2025
•
SIGN LANGUAGE TO TEXT/SPEECH
To create a computer software and train a model using cnn which takes an image of hand gesture of ASL and shows the output of the particular sign language in text format and convert audioas well.
The problem SIGN LANGUAGE TO TEXT/SPEECH solves
More than 70 million deaf people around the world use sign languages to communicate. Sign language allows them to learn, work, access services, and be included in the communities.
It is hard to make everybody learn the use of sign language with the goal of ensuring that people with disabilities can enjoy their rights on an equal basis with others.
So, the aim is to develop a user-friendly human computer interface (HCI) where the computer understands the American sign language This Project will help the dumb and deaf people by making their life easy.
Challenges I ran into
- Handling varying lighting conditions.
- Ensuring accuracy across different hand sizes & orientations.
- Optimizing model for real-time performance.
Tracks Applied (1)
Ethereum Track
ETHIndia
Technologies used
Webcam captures hand gestures.
- Image preprocessing using OpenCV & MediaPipe.
- CNN model classifies gestures into text.
- Text converted to speech using pyttsx3.
*Pillow*: A fork of the Python Imaging Library (PIL) that provides tools for image processing
*TensorFlow*: An open-source machine learning framework
NumPy*: A powerful numerical computing library used for working with arrays
performing mathematical operations
and handling large datasets efficiently.