Google Translate expands real-time translation with AI and gets language trainer

The Google translator can handle live conversations in 71 languages thanks to AI, even in noisy environments. A language trainer for conversations is available.

listen Print view
Keyboard with different flags on keys and Translate key

(Image: cybrain / Shutterstock.com)

3 min. read

Google is adding a new language trainer to its translation service. This should enable users to easily learn practical conversations in foreign languages. At the same time, the previously enabled live translations are being expanded thanks to artificial intelligence to make it easier to communicate with other people in foreign languages and in real time. Thanks to AI, this is now also possible in environments with a lot of background noise and in more than 70 languages.

About a year ago, Google Translate was given 110 new languages, including Southern Low Franconian, and the Google translator has also mastered less common dialects since then. This has almost doubled the number of languages from 133 to 243, but this does not include live translations. Even with the current expansion, this is still only possible in 71 languages, such as Arabic, Hindi, Korean and Tamil, but of course also widely spoken languages such as French and Spanish.

The Google Translate app for both Android and iOS will soon enable back-and-forth conversations with audio and screen translations in these languages. To do this, users tap on "Live translation" in the translator app, select the desired language and can then speak. The app translates this in real time and logs it in both languages. As soon as there is a longer pause in speech, the translation is read out loud so that the other person can listen in.

Videos by heise

The data company writes in its own blog that the app uses Google's "advanced voice and speech recognition models", which are trained to filter out sounds. This should make it possible to use these live translations even at a busy airport or in a noisy restaurant in a foreign country. This function is initially available to users in the USA, India and Mexico.

By integrating a language trainer into the translation service, Google is directly attacking language learning apps such as Duolingo, as well as apps that use AI as a language trainer. According to Google, this function is not only aimed at people who want to start conversations in a foreign language, but also at advanced users who want to brush up on their language skills, for example for an upcoming trip.

In the translator app, the user first selects "Practice" and chooses the language level and goals. Google Translate then offers various scenarios in which you either listen first and then select the words you know, or you can start speaking straight away. The app provides tips if required and records your daily learning progress.

Empfohlener redaktioneller Inhalt

Mit Ihrer Zustimmung wird hier ein externes YouTube-Video (Google Ireland Limited) geladen.

Ich bin damit einverstanden, dass mir externe Inhalte angezeigt werden. Damit können personenbezogene Daten an Drittplattformen (Google Ireland Limited) übermittelt werden. Mehr dazu in unserer Datenschutzerklärung.

The Google Translate language trainer will initially be available to English-speaking users who want to learn Spanish or French, as well as Spanish, French or Portuguese-speaking users who want to practise their English.

(fds)

Don't miss any news – follow us on Facebook, LinkedIn or Mastodon.

This article was originally published in German. It was translated with technical assistance and editorially reviewed before publication.