Upcoming Gemini app for macOS reportedly to analyze screen content
To catch up with the competition, Google is developing a macOS app for Gemini. It is intended to interact with the user's apps and data.
(Image: Sebastian Trepesch / heise medien)
Gemini is apparently coming to Mac as an app: Google has reportedly distributed a first macOS version of the chatbot to a wider circle of beta testers. An official announcement is still pending. Gemini is currently only available on desktop operating systems via browser or as a web app, which significantly limits its functionality and puts it far behind competitors ChatGPT and Claude.
Gemini can “see what you see”
The macOS app of Gemini offers functions known from the mobile version. Testers are to try out AI generation of images, videos, and music, as well as test table creation and information analysis, reports the financial news agency Bloomberg. The beta version currently only offers these basic functions.
Videos by heise
At the same time, however, deeper integration into Apple's desktop operating system seems to be planned: According to reports, the app's code already contains a reference to the “Desktop Intelligence” function: This is intended to enable Gemini to analyze screen content and thus read data and content from other apps. Activation allows the Gemini app to “see what you see (e.g., screen context)”, Bloomberg quotes from the note in the code.
ChatGPT and Claude offer deep desktop integration
The native macOS version of ChatGPT already allows collaboration with certain other apps, including Apple Notes, Terminal, and Xcode. Codex and Claude Code are also capable of reading local files and executing shell commands – and thus directly working with the user's data and controlling the Mac to a limited extent.
Apple has announced a new version of Siri that is intended to take user context and personal data into account and can perform actions across apps. The manufacturer has not yet been able to implement these AI functions with its AI models. A deal with Google now allows Apple to use Gemini as the basis for future AI functions in its operating systems.
Empfohlener redaktioneller Inhalt
Mit Ihrer Zustimmung wird hier ein externer Preisvergleich (heise Preisvergleich) geladen.
Ich bin damit einverstanden, dass mir externe Inhalte angezeigt werden. Damit können personenbezogene Daten an Drittplattformen (heise Preisvergleich) übermittelt werden. Mehr dazu in unserer Datenschutzerklärung.
(lbe)
