Google's 'Translatotron' AI can translate in speaker's voice: Here's how

If you have used Google Translate or any other voice translation tool, you must already know that the current translation systems involve multiple layers.

The words you speak are first recognized and converted into text, then that text is converted into the language you prefer, and finally, the converted text is synthesized as a vocal output, which sounds like a robot speaking.

In a bid to make this 'multi-layered' process simpler, Google has announced its experimental Translatotron system.

The company says that the tech uses machine learning to convert words and sentences spoken in one language into another language without involving texts in between.

This, naturally, makes the translation process faster and reduces the risk of errors that could occur in multi-step translation.

After working on the idea of speech-to-speech translation for years, Google brought Translatotron to life by converting spectrograms of speech in one language to spectrograms in another, using machine learning algorithms.

For the uninitiated, spectrograms are detailed frequency breakdowns of audio as it varies with time; they are also dubbed as sonographs, voiceprints, or voicegrams.

These spectrograms help the system with direct translation.

The process, as we said, is faster than the conventional technique, but more importantly, it comes with the element of expression.

Essentially, the system relies on a neural vocoder and speaker encoder, which helps the system retain the speaker's vocal characteristics in the translated speech.

So, instead of expression-less robotic voice, the translation comes out with the same tone, voice of the original speaker.

While Translatotron could be the way to define machine-based speech translation, it is not absolutely perfect.

Google says the system's translations aren't as accurate as those you get from regular translation technologies.

It still needs to evolve, but in case you want to hear Translatotron speaking, head over to https://bit.ly/2EdKsUb. It is not half bad.