Shivam Singh

Our project is a real-time sign language translator that enables seamless communication between deaf/mute individuals and the hearing population. It converts sign language to text and text to sign using a combination of AI models, computer vision, and a modern web interface. The system uses a Next.js frontend and a Python (FastAPI) backend integrated with MediaPipe, OpenCV, and a custom-trained CNN model (asl_model.h5). This model was trained on a self-created dataset using Canva, where hand landmarks were captured and labeled. In Sign-to-Text mode, hand gestures are detected via webcam, processed using MediaPipe, and passed to the AI model to predict each character, eventually forming words and sentences. In Text-to-Sign mode, users enter text, and the system returns corresponding Indian Sign Language (ISL) signs as images, allowing hearing individuals to communicate back effectively.