C

Cloud Connect

A SERVICE THAT HELPS DISABLED PEOPLE TO INTERACT BETTER, FASTER AND IN ANY LANGUAGE.

The problem Cloud Connect solves

Language barrier –
Whether you are trying to communicate with a foreign cab driver or a store clerk, our service is your personal interpreter that you can trust. Need interpretation service for a business meeting in China, Japan or any other place that English is not the first language? Our service provides you with your personal interpretation service directly over your smartphone. Getting quality human interpretation anywhere has never been easier.

Empowering disabled –
For a person with hearing disabilities, real world audio transcription is very comforting and empowering. Likewise for people with sight disabilities , text-to- speech service helps them tremendously.

Language learning pal –
A world where finding native speakers is really tough, leveraging technology to help people learn and practice new languages is an enormous help.

Multi Channel Transcription-
All ideas doesn’t come from common language so our service helps you to annotate and transcribe from video conferences and audios.

Challenges we ran into

  1. Converting audio from stream to a format which Google Speech to text can process
  2. Selecting various audio formats such as LINEAR16
  3. Integrating sockets into our express server
  4. Sending audio streams through sockets from server to client
  5. Processing Javascript inputs through socket emit function
  6. Dynamically streaming text into our input box
  7. Choosing the appropriate templating engine
  8. Solving how to integrate async functions in JavaScript
  9. Solving Unfulfilled promises
    10)Integrating some dynamic CSS into the User Interface
    (Mark Down)
    io.on("connection", function (client) {
    console.log("Client Connected to server");
    let recognizeStream = null;

client.on("join", function () {
client.emit("messages", "Socket Connected to Server");
});

client.on("messages", function (data) {
client.emit("broad", data);
});

client.on("socketdeneme", (msg) => {
console.log(msg);
request.config.languageCode = msg;
});

client.on("textlanguage", (data) => {
console.log("language " + data);
tr.target = data;
});

client.on("texttoconvert", (data) => {
console.log("text " + data);
tr.text = data;
async function translateText() {
// Translates the text into the target language. "text" can be a string for
// translating a single piece of text, or an array of strings for translating
// multiple texts.
let [translations] = await translate.translate(tr.text, tr.target);
translations = Array.isArray(translations)
? translations
: [translations];
console.log("Translations:");
// translations.forEach((translation, i) => {
// console.log(

${text[i]} => (${target}) ${translation}

);
// });
let str = "";
translations.map((translate) => {
str += translate;
});
console.log(str);
client.emit("transdata", str);
}

translateText();

});

Discussion