Google integrates AI into Translate and expands learning tool
Google wants to improve translations with Gemini in Translate. Google is bringing live translations for all headphones and the learning tool to Germany.
(Image: Google)
Google Translate is receiving a major update. According to the company, “Gemini's most powerful translation features” for text are being integrated into the translation app and search. Live speech-to-speech translations with all headphones are launching as a beta for some languages, but not yet in Germany. Previously, this only worked with Google's own Pixel headphones.
Google Translate to better handle idioms
Thanks to Gemini integration, Google Translate is expected to be more precise in text translations. The tool should translate idiomatic expressions, phrases, and slang more accurately than before. As Google writes in its announcement, Google Translate will no longer provide literal translations; instead, the AI model analyzes the context to find a more fitting translation. The company cites the English idiom “stealing my thunder,” which literally translates to “stiehlt mir den Donner” (steals my thunder). Google Translate will now provide the correct idiomatic translation, “mir die Show stehlen” (steal my show).
(Image:Â heise medien)
According to Google, the AI-optimized text translation will initially be available in the US and India for English translations into nearly 20 languages, including Spanish, Hindi, Chinese, Japanese, and German. An initial test showed that it is not yet available in search but is on the Google Translate website.
Videos by heise
Real-time translation for all headphones
In line with the release of iOS 26.2, which among other things provides Apple with live translation with AirPods in the EU, Google announced on December 12 that it would expand the availability of live translation with headphones, which was previously only available for its Pixel Buds models. According to Google, the feature will initially be provided as a beta version for Android users in the US, Mexico, and India. It supports over 70 languages. An expansion to iOS and for more countries is planned for 2026.
With the speech-to-speech translation function, users will be able to hear real-time translations directly in their headphones. The “tone, emphasis, and intonation of each speaker” are to be preserved “to create more natural translations and make it easier to follow the conversation and recognize who said what,” the company states. The AI also filters out background noise to make the translations usable even in noisy places like airports or restaurants.
According to Google, users can use the function not only to converse in another language or listen to a speech or lecture abroad, but also to watch a TV show or movie in another language. All they have to do is “put on their headphones, open the Translate app, tap 'Live Translate,' and hear a real-time translation in their preferred language.”
Learning tool
Google has also thought of users who use Google Translate to learn a language. According to the company, the language learning tools in the Translate app have received an improved feedback function that provides users with helpful tips based on their speaking exercises.
(Image:Â Google)
Relevant for Germany: The language learning tool introduced in August is now also available for use in Germany. According to the announcement, Google is expanding the offering to almost 20 new countries, including Germany, India, Sweden, and Taiwan. Among other things, Google offers learning tools for English to German and Portuguese, as well as Bengali, Mandarin Chinese (simplified), Dutch, German, Hindi, Italian, Romanian, and Swedish to English.
Furthermore, Google is introducing a gamification feature that allows users to challenge themselves and achieve their learning goals by tracking how many consecutive days they have been learning. This enables learners to monitor their progress and continuity over time.
(afl)