VirtuLingo
A virtual-reality platfform for practising the language you love, with real-life scenarios.
Created on 1st March 2025
•
VirtuLingo
A virtual-reality platfform for practising the language you love, with real-life scenarios.
The problem VirtuLingo solves
Our project helps users practice their communication skills by creating realistic virtual scenarios, like shopping, attending a party, or joining a meeting. Instead of just learning passively, users can engage in real conversations that feel natural and relevant to everyday situations. Each interaction is personalized to match their skill level and preferences, making the experience more engaging and effective. Plus, the system provides live corrections, offering instant feedback on grammar, pronunciation, and sentence structure. This way, users can improve in real time and build confidence in their communication skills, whether for social gatherings, professional settings, or everyday conversations.
Challenges we ran into
While building this project, one of the biggest challenges we ran into was getting text-to-speech and speech-to-text to work smoothly. We had to make sure the language model (LLM) was generating natural and accurate speech while also correctly understanding user input, which wasn’t always easy. On top of that, dealing with the delay in speech processing was a real issue any lag in converting text to speech or vice versa could make the experience feel clunky. To fix this, we focused on fine-tuning the LLM’s responses to make them more precise and natural, while also working on reducing latency to keep interactions quick and seamless. Solving these problems made a huge difference, helping us create a system that feels much more fluid and user-friendly.
Tracks Applied (1)
Student
Technologies used