Skip to content
ACCESSIBLE LEARNING

ACCESSIBLE LEARNING

Speech to Braille and Sign to Text Transaltion System

Created on 8th January 2023

ACCESSIBLE LEARNING

ACCESSIBLE LEARNING

Speech to Braille and Sign to Text Transaltion System

The problem ACCESSIBLE LEARNING solves

Our Aim is to create a system that can provide an accessible way for the deaf and blind to access audio-video content, by providing a Speech to Braille translator and Sign Language Recognition System. This system should be able to convert speech to braille, detect signs in order to teach sign language, and output letters corresponding to the signs shown. This system will help bridge the gap between the differently-abled and modern society, by providing a two-way approach, allowing normally-abled people to learn braille script and sign language as well.The Speech to Braille project has a two step process. The 1st step is to convert speech to text using a speech recognition library like SpeechRecognition. The 2nd step is to convert the text to braille. In order to convert speech to text, the speech recognition library will listen to the user’s voice and convert it to a text string or will take input audio file and convert it into a text string. The text string can then be parsed using a natural language processing library to extract meaningful information from the text string. The second step is to convert the text string to braille. The text obtained is then converted to Braille using a predefined mapping of English alphabets and numbers to their corresponding Braille characters.The braille string can then be displayed on a braille display grid.Sign language detection is a process of recognizing the sign language gestures and converting them into text. This process is achieved by using CV, ML and Neural Networks. First, the image of the sign language gesture is captured using a camera. Then, the image is processed in order to extract the features of the sign language gesture. This is done by applying filters, such as Gaussian blur, adaptive thresholding. Once the features of the sign language gesture are extracted, they are fed into a machine learning model.. Once the prediction is made, the sign language gesture is converted into text and this used to make sentences

Challenges we ran into

There are many blind people, not only blind people there are many people who are Disabled like dead and mute so keeping in mind about the all 3 categories we developed an Interface where people can make the 3 conversions Based on the user interest he can select a particular method which he requires,Our speech to text,Text to braille,Audiofile to text These conversions are helpful for the different categorical people .In each step we use different methods of coding . Algorithm:
For the speech to text Here we get the access of the microphone and the user is requested to talk about what he wants to convert and then the collected speech is gathered and it is converted to the text steps are

  1. Create a speech recognizer object (r)
  2. Prompt the user to speak
  3. Use the microphone (source) to listen for the user's input
  4. Save the user's input as an audio file (audio)
  5. Print a message to indicate the user is done speaking ("OVER, THANKS")
  6. Attempt to recognize the user's input using the speech recognizer (r)
  7. If successful, print the recognized input.
    For text to braille
    First we use different variables of list data structures to store all letters of alphabets and their respective braille letters and also the numbers and the special symbols then we followed the below steps
  8. Create a variable to store the input string
  9. Create a variable to store the translated Braille output
  10. For each character in the input string:
    a. Check if the character is in the alphabet list
    i. If it is, add the corresponding Braille character to the output string
    b. Check if the character is in the numbers list
    i. If it is, add the corresponding Braille character to the output string
    c. Check if the character is in the punctuation list
    i. If it is, add the corresponding Braille character to the output string
    d. Check if the character is in the character list
    i. If it is, add the corresponding Braille character to the output string

Discussion

Builders also viewed

See more projects on Devfolio