Communication between specially-abled and abled people can be problematic, inconvenient, and expensive. This project attempts to bridge the communication gap by designing a portable glove that captures the user’s sign language gestures and outputs the translated text on a smartphone.
The main aim of this project is to discuss the novel concept of glove based system that efficiently translates Sign Language gestures to auditory voice as well as text by using hand gestures and also promises to be portable so, problems faced by the disabled person regarding communication can be overcome by our method. This ensures that by using these gloves they can indulge them in an activity where they may say themselves as an independent person.
We used NodeMCU, Arduino UNO, Flex Sensors and Android SDK to complete this project.
First we receive the Analog Input from Flex Sensors to Arduino. Then pass the data to NodeMCU. It connects to Wifi and sends the data to server in payload.
At the server side, we have php files handling the input data from NodeMCU. These files help to receive data and update to Database.
As of now we were unable to arrange a glove so designed the whole system on breadboard only.
we are processing all the data in the Android App only, so on our next update on this appication will be we can customize the messages according to the user.
First of all we decided to use Arduino UNO along with Bluetooth sensor, but at the very moment our bluetooth sensor got some issues, and stopped working.
So we tried to use Arduino to read Analog values from Flex Sensors, and then pass the serial output to Computer through which our Arduino was connected. Our python program was managing the serial output and passed it into our web server where php files were handling the post input and sending to database.
But the idea was to make a smart glove that can be connected to your Android Phone wirelessly, and person can't carry there laptop for long, so we switched to NodeMCU. It has prebuilt Wi-Fi module which can be easily connected to your phone.
But again the challenge was the input. NodeMCU do not support Analog Input like Arduino so we used ADC module (Analog to Digital Convertor) but due to lack of experience with that and time constraints we were not able to configure that. So we again switched to Arduino, passed the serial output to nodemcu and send the data to webserver and receive on our Android Application.
Technologies used
Discussion