Visionos 2.4: That comes with the vision-pro-update

It was unclear for a long time whether Apple Intelligence also came to the Vision Pro-at times observers thought that the M2 processor built into the devices was too busy with the spatial computing functions-from eye tracking to room recording. But with Visionos 2.4, which is expected in the next few weeks and has been in the beta test for developers since last week, Apple's AI system has now come: With all the central features from the “Writing Tools” about the image generators (Image Playground, Genoji) to towards the intelligent summaries. But that's not all that is new in Visionos 2.4. Here is an overview of the already known functions of an update, which is promising despite the small version number jump.

AI on the Vision Pro

Apple Intelligence should be integrated in Visionos 2.4 as deeply as in iOS, iPados and MacOS. The beta initially only dominates American English as a language variant, later a year should follow further languages. With the Writing Tools you can rework, summarize and adapt texts – including the possibility of also asking Chatgpt for help. Image Playground builds drawings and sketches as well as comic pictures, but no photo-realistic graphics. Genoji creates Ki-Emojis from previously typed terms, which can then be used in the news app, among other things.

Smart Reply allows you to answer text messages and emails quickly-Apple Intelligence makes suitable suggestions for context. In the photo app under Visionos you can create “Memory Movies” promptly input, picture shows with music made from existing photos and videos in the media library. There are still improvements in the search in photos that should now also understand natural language. Mails and notifications are sorted or summarized on request for priority (which does not always work well) and in notes there is the image-wall image generator for drawings. As already used on Mac, iPhone and iPad, Apple uses a locally executed models, that is not enough, the data goes to a private cloud compute data center, which is completely encrypted and cannot be viewed by the group.

Further innovations in the update

Visionos 2.4 continues to offer a new “Spatial Gallery”, in which entertainment, videos, photos and panoramas are compiled, which present the 3D features of the Vision Pro. This also includes Behind-the-scenes content from Apple TV+shows. A new vision-pro app for the iPhone allows simpler management of the headset, it is available under iOS 18.4 (also currently in Developer Beta).

You can have apps prepared for download, discover new content and get tips on how to use the Vision Pro. There is also an improved guest mode (“Guest User”) for the Vision Pro, which can be controlled using iPhone or iPad. A view mirroring is also integrated, so you can watch what the guest user is doing.