T

TalkEasy

Talk easily on video calls even in different languages

The problem TalkEasy solves

People face language barriers when it comes to the conference meetings around the globe. TalkEasy allows them to communicate in their own languages.

  • Currently in the market, there are a few apps like Zoom and Skype that do allow translation. Zoom allows translation in the mode of a physical translator joining the users meeting. Skype shows translated subtitles in the language the user prefers but only for 11 langauges and none of them are Indian langauges and also it does not convert it back to audio

We provide the following features -

  • 70 languages with different accents including Indian languages are supported by TalkEasy whereas skype supports only 11 languages.
  • Realtime subtitles just like you are watching a movie
  • Users can speak in multi-languages in a call which gets translated too.
  • After the speaker completes a sentence, the receiver receives the translated audio in the selected language.
  • Once the meeting has ended, the user receives an option to download the entire meeting’s transcript in one of the languages that the meeting was in

Challenges we ran into

One of the main issues we faced was the lag in between audio and video of the meeting. Since we are using multiple APIs for processes like speech recognition, translation, and speech synthesis there was a lag occurring.
But we managed to reduce this lag by using the Realtime Database of Firebase to less than a second.

  • One of our competitors was Skype as they have a translation system of their own using which they display translations to users. We researched their methods and worked through implementing a similar system and provide subtitles for 7 times the languages that they support

  • Implementation of WebRTC was difficult since we had to implement video calls for users to be able to see each other

Discussion