FingerSpell
Sign up for better future
The problem FingerSpell solves
Barrier to Communication: FingerSpell provides a way for differently abled individuals to communicate with each other and with hearing individuals.
Language Acquisition and Educational Access: It allows differently abled individuals to learn and acquire language skills. Sign language can be used as a first language, or as a way to support the learning of a spoken language.
Social Inclusion: FingerSpell can help to promote social inclusion for differently abled individuals by allowing them to participate in conversations, events, and activities that would otherwise be inaccessible to them.
Employment Opportunities: Sign language proficiency can increase employment opportunities for differently abled individuals, as it can be used in a range of professions, such as interpreting, education, and advocacy.
Challenges we ran into
Limited availability of sign language datasets: We needed access to large datasets of sign language videos and their corresponding translations to create effective machine learning algorithms. However, these datasets were often limited in size and quality. We overcame this issue by collecting our own data.
Collection of Data: The data collection process was tedious and time-consuming as for every hand gesture, we recorded multiple images from various positions in order to ensure the accuracy of the model. It took a long while but was essential to ensure the authenticity of our project.
Linguistic Complexity: In order to record the data for different sign languages, we had to learn about the different gestures of each language. Sign languages are complex and differ from spoken languages, so we needed to ensure that FingerSpell can accurately capture and interpret these complex gestures and movements.