Essential Voice:Nothing enhances operating system with AI-powered voice function

The startup Nothing is expanding its operating system with the AI function Essential Voice, which is intended to clean up and optimize voice input in real-time.

listen Print view
Nothing Phone 4a and 4a Pro one above the other

Nothing is further expanding its AI ecosystem.

(Image: Andreas Wodrich / heise medien)

4 min. read

Nothing is working on its AI system as a kind of cornerstone of its Android-based operating system Nothing OS. With the now announced Essential Voice, the manufacturer wants to improve voice input and lead to “a more natural form of interaction with the smartphone”.

With Essential Voice, Nothing wants to improve voice control and speech recognition to clean up dictated content in real-time and thus quickly convert it into “usable text”. The company wants to combine “the speed and simplicity of speaking with the clarity and flexibility of text”.

The function can be started either by pressing the Essential button or by a button on the keyboard, so that it is accessible everywhere, so to speak. It is also integrated into the areas where you write, so you don't have to interrupt a conversation, Nothing further explains.

The tool is said to automatically rearrange the spoken text, remove filler words like “ahs” and “ohs” as well as stutters, so that the spoken words “sound like finished text – and not like a transcription”. Nothing calls this “automatic correction”.

With the “Personal Mappings” function, according to Nothing, it is possible to create and use individual voice commands for words, links, templates, and frequently used phrases. In addition, the tool can be used as a translation assistant. You can speak in one language and ask Essential Voice to compose the text in another language.

Videos by heise

At launch, the tool is said to support over 100 languages and automatically recognize languages. Users can also select regional variants such as Latin American Spanish or simplified Chinese.

Essential Voice is to be expanded with further functions later. For example, the company plans context-dependent functions with which the tool can adapt to the respective writing context, such as messages, business emails, or search queries.

Furthermore, the company hopes that Essential Voice can be used “as a precursor to a new, voice-controlled user interface” throughout the entire ecosystem of smart products.

Some of the first features of Essential Voice.

(Image: Andreas Floemer / heise medien)

Nothing has set itself the goal of developing an AI-based operating system Essential OS, which should be more personal and come with a generative user interface. For the development of a personal, generative user interface including an AI-native platform, Nothing had raised 200 million US dollars last year. For this purpose, Nothing had announced the AI tool Playground in February, with which users can create their own mini-apps using Vibe Coding.

Nothing envisions the mobile platform of the future as highly individualized: you can simply describe in natural language what functions or tools you currently need, for example: “Scan the receipts from photos and export a finished PDF of all finances every Friday”. Alternatively, the AI should be able to generate a one-page briefing based on the calendar invitation and the email thread before meetings or create a “mood tracker” that synchronizes with a playlist. These apps should then simply be placed on the home screen. Essential Voice is likely to be a relevant fundamental component for the voice interface.

Interestingly, Google launched an AI dictation app on the market just a few days ago, which automatically optimizes speech offline on the smartphone. However, the app is currently only available for iOS, but not in the EU.

Essential Voice can initially be tried out on the Phone (3) and the Phone (4a) Pro, the Phone (4a) will follow in May, according to the manufacturer.

Empfohlener redaktioneller Inhalt

Mit Ihrer Zustimmung wird hier ein externer Preisvergleich (heise Preisvergleich) geladen.

Ich bin damit einverstanden, dass mir externe Inhalte angezeigt werden. Damit können personenbezogene Daten an Drittplattformen (heise Preisvergleich) übermittelt werden. Mehr dazu in unserer Datenschutzerklärung.

(afl)

Don't miss any news – follow us on Facebook, LinkedIn or Mastodon.

This article was originally published in German. It was translated with technical assistance and editorially reviewed before publication.