The problem SWAYAM solves

In response to the challenges faced by the differently abled individuals in accessing digital content,this project is dedicated to fostering inclusivity through innovative technology. This project integrates cutting-edge features such as gesture navigation, a color-blind-friendly interface, avatar-guided sign language learning, voice input with advanced AI, Gemini-driven responses, object detection, and YouTube video summarization with sign language interpretation.
Gesture Navigation: Intuitive gestures facilitate effortless navigation through the app's interface, enhancing accessibility for visually impaired users.

Color-blind-friendly Interface: The interface prioritizes inclusivity, ensuring comfortable interaction for users with color vision deficiencies.

Avatar-guided Sign Language Learning: Lifelike avatars employ advanced animation technology to guide users through sign language learning, fostering communication and understanding within the visually impaired community.

Voice Input with Advanced AI: Users can input queries and commands using their voice, receiving accurate responses powered by advanced language models.

Object Detection: Object detection capabilities empower users to identify objects in their surroundings, enhancing independence in daily tasks.

YouTube Video Summarization with Sign Language Interpretation: Video summarization with sign language interpretation enables visually impaired users to access multimedia content with ease.

Games: Including games taht promote learning for dyslexic and ADHD suffering individuals.

Challenges we ran into

Throughout the development of our project, we encountered several challenges that required innovative solutions and collaborative problem-solving. One significant hurdle we faced was defining the scope of the project and determining how to address the diverse needs of our target audience effectively.

Initially, we grappled with the question of how to integrate various accessibility features into a single cohesive platform. We recognized that our project aimed to empower differently abled individuals by providing them with access to information, communication tools, and learning resources. To overcome this challenge, we decided to consolidate all features into a unified platform, ensuring seamless accessibility and usability for our users.

One particular issue we tackled was devising a navigation system that would allow blind users to navigate through the app effortlessly. After extensive research and experimentation, we implemented gesture navigation, enabling users to intuitively interact with the interface using simple gestures. This solution not only addressed the navigation challenge but also enhanced the overall user experience, promoting ease of use and accessibility.

Another obstacle we encountered was the development of avatar-guided sign language learning functionality. Integrating lifelike avatars capable of accurately depicting sign language gestures presented a unique technical challenge. To overcome this hurdle, we leveraged the SigML dataset and the Spacy library, which provided us with the necessary resources and tools to create realistic and interactive avatars. By harnessing these technologies, we were able to develop a robust sign language learning module that enhances communication and inclusivity within the visually impaired community.