visionOS 2.4: What's coming with the Vision Pro update
Apple is upgrading important functions with the new Vision Pro operating system, which will be released soon. It's not just about Apple Intelligence.
Apple Intelligence at Vision Pro: The unexpected often happens.
(Image: Apple)
For a long time, it was unclear whether Apple Intelligence would also be coming to the Vision Pro – At times, observers thought that the M2 processor built into the devices was too busy with the spatial computing functions – from eye tracking to spatial recognition –. But with visionOS 2.4, which is expected in the next few weeks and has been in beta testing for developers since last week, Apple's AI system is coming after all: with all the central features from the “Writing Tools” to the image generators (Image Playground, Genmoji) to the intelligent summaries. But that's not all that's new in visionOS 2.4. Here is an overview of the already known functions of an update that is promising despite the small version number jump.
AI on the Vision Pro
Apple Intelligence is to be as deeply integrated in visionOS 2.4 as it is in iOS, iPadOS and macOS. The beta initially only supports American English as a language variant, with other languages to follow later in the year. The Writing Tools can be used to edit, summarize and adapt texts – including the option to ask ChatGPT for help. Image Playground creates drawings and sketches as well as comic images, but not photorealistic graphics. Genmoji creates AI emojis from previously typed words, which can then be used in the Messages app, among other things.
Videos by heise
Smart Reply allows you to quickly reply to text messages and emails – Apple Intelligence makes suggestions that fit the context. In the Photos app under visionOS, you can also create “Memory Movies”, picture shows with music from existing photos and videos in the media library, using prompt input. There are also improvements to the search function in Photos, which now also understands natural language. Mails and notifications can be sorted or summarized by priority (which doesn't always work well) and in Notes there is an image wall generator for drawings. As on Mac, iPhone and iPad, Apple uses locally executed models; if this is not sufficient, the data is sent to a private cloud compute data center, which is completely encrypted and cannot be viewed by the company.
Other new features in the update
visionOS 2.4 also offers a new “Spatial Gallery”, in which entertainment content, videos, photos, and panoramas are compiled to showcase the 3D features of the Vision Pro. This also includes behind-the-scenes content from Apple TV+ shows. A new Vision Pro app for the iPhone makes it easier to manage the headset and is available under iOS 18.4 (also currently in developer beta).
It can be used to prepare apps for download, discover new content and get tips on how to use the Vision Pro. There is also an improved guest mode (“Guest User”) for the Vision Pro, which can be controlled via iPhone or iPad. View mirroring is also integrated, so you can see what the guest user is currently doing.
Empfohlener redaktioneller Inhalt
Mit Ihrer Zustimmung wird hier ein externer Preisvergleich (heise Preisvergleich) geladen.
Ich bin damit einverstanden, dass mir externe Inhalte angezeigt werden. Damit können personenbezogene Daten an Drittplattformen (heise Preisvergleich) übermittelt werden. Mehr dazu in unserer Datenschutzerklärung.
(bsc)
