Apple has announced the upcoming launch of Apple Intelligence, set to debut on the Apple Vision Pro, bringing a series of groundbreaking AI applications to spatial computing. This update includes powerful features like the text editing in the "Writing Tool" and integration with ChatGPT, as well as AI-generated image creation in the "Image Playground," while Genmoji helps users design personalized emojis. Additionally, the brand new visionOS 2.4 introduces the "Spatial Gallery" app, enhancing the experience of art and entertainment content; the iPhone version of the "Apple Vision Pro" app is also on the way, allowing users to manage Vision Pro applications and settings conveniently through their iPhone.
Apple Intelligence has rolled out multiple AI features for Vision Pro, designed to boost user productivity and creativity. The 'Writing Tool' assists users in rewriting, proofreading, and summarizing text in applications like 'Mail', 'Notes', and more, even leveraging ChatGPT to generate new content. With the 'Rewriting' feature, users can tweak the tone of their text to be more professional, friendly, or concise; while 'Proofreading' checks grammar and provides editing suggestions. The 'Summarizing' feature can transform selected text into various formatted summaries.
At the same time, the "Image Playground" feature allows Vision Pro users to create unique images using AI. By simply inputting a description, the system can generate corresponding visuals, even creating images reminiscent of friends and family based on the user's personal photo library. This feature can be integrated into applications like "Messages" and "Freeform," or used independently.
Genmoji allows users to create personalized emojis through AI, which can be embedded in messages, converted into stickers, and used for "tap responses." Additionally, the "smart reply" feature offers feedback suggestions based on message content, enhancing communication efficiency.
Apple Intelligence has also enhanced the "Photos" app by introducing the "Make Memories" feature, allowing users to simply input descriptions, and the AI will select the best images and videos from the photo library to create a narrative video with added music. The "Natural Language Search" feature is particularly impressive, enabling users to search for specific photos or videos with simple descriptions, eliminating the hassle of manual filtering.
With the launch of visionOS 2.4, the "Spatial Gallery" app, designed specifically for Vision Pro, offers immersive "spatial photos," "spatial videos," and "panoramic" content from artists, filmmakers, and photographers. Featured content includes works from photographer Jonpaul Douglass and Samba Diop, along with immersive experiences from brands like Cirque du Soleil, Red Bull, and Porsche. Additionally, Apple has provided behind-the-scenes footage for Apple Original shows such as "The Book of Death," "Life Severance Techniques," and "The Honest Treatment."
At the same time, Apple has launched the iPhone version of the "Apple Vision Pro" app, allowing users to download Vision Pro apps and games through their iPhone, explore content from Apple TV and the "Spatial Gallery," and access device information and usage guidelines. This app will automatically appear after the iOS 18.4 update or can be downloaded from the App Store.
visionOS 2.4 has improved the 'Guest User' feature, making it easier for Vision Pro users to share their device with friends and family. Users can activate Guest Mode through a nearby iPhone or iPad, allowing them to select from available apps. Additionally, guest hand and eye tracking data will now be retained for 30 days, providing a more convenient user experience.
With visionOS 2.4 and Apple Intelligence, Apple continues to enhance the AI and spatial computing experience of Vision Pro. More languages and features will gradually be added in the future, further expanding its application scenarios.
