Musk's AI chatbot Grok gets eyes

Elon Musk's AI chatbot Grok gets eyes. From now on, the app can answer questions about what is happening in the smartphone camera's field of vision.

listen Print view
Grok logo

xAI's AI chatbot Grok gets new functions.

(Image: xAI)

2 min. read

Similar to Google's Gemini Live and OpenAI's ChatGPT, xAI's Grok now has eyes, so to speak. On Tuesday, Elon Musk's company announced the Grok Vision function, which allows users to point their smartphone at products, signs, and documents and ask questions about them. The content of the smartphone screen can also be analyzed.

As xAI employee Ebby Amir writes on X, Grok Vision via the Grok app is currently only accessible via the iPhone app. Android users will have to be patient.

In the article on X, xAI also announced two further updates for Grok's voice mode. The chatbot can now recognize answers not only in English, but also in other languages. In addition to Spanish, French, Turkish and Japanese, Hindi is also supported. German is not yet available.

Videos by heise

Real-time search in Grok voice mode is also new. According to xAI, both functions can be used on Android. However, the paid Super Grok plan, which costs 30 US dollars per month, is required to use them.

Musks Grok has gained many new functions in recent months. For example, the chatbot can remember previous conversations, which could indicate that the application could be developed in the direction of a personal AI assistant.

Grok 3, a new AI family consisting of a small and large model and associated reasoning models, was released in February. According to Elon Musk's specifications, the company has hardly set any limits for Grok 3's voice mode: The voice mode can also moan, swear and more, which is not possible with competitors.

Data protectionists have also become aware of Musk's AI company xAI. The Irish data protection authority is investigating how Musk's Platform X used personal data of European citizens to train Grok's AI model.

(afl)

Don't miss any news – follow us on Facebook, LinkedIn or Mastodon.

This article was originally published in German. It was translated with technical assistance and editorially reviewed before publication.