This update promises to revolutionize spatial computing by integrating a robust suite of AI-driven features—including Writing Tools, Image Playground, and Genmoji—alongside new apps like Spatial Gallery and an enhanced Apple Vision Pro app for iPhone. Set to launch in beta with U.S. English support, these advancements aim to boost productivity, creativity, and user engagement while maintaining Apple’s hallmark privacy standards.
Apple Intelligence: A New Frontier for Vision Pro
Apple Intelligence introduces an array of tools designed to streamline tasks and inspire creativity. Writing Tools will allow Vision Pro users to refine text effortlessly across apps like Mail, Notes, and third-party platforms. Features include rewriting text to adjust tone—whether friendly, professional, or concise—proofreading for grammar and structure, and summarizing content into concise formats. A ChatGPT-powered Compose option even lets users generate original text based on their prompts, making it a game-changer for writers and communicators.
For visual expression, Image Playground offers a playground of possibilities. Users can craft unique images from themes, accessories, or personal photo libraries, integrating them into apps like Messages or Freeform. Meanwhile, Genmoji takes emoji creation to the next level, enabling users to design custom emojis by typing or speaking descriptions, perfect for adding flair to conversations. These features, available in beta this April, will expand with additional functionalities and languages throughout the year.
Privacy remains a cornerstone of Apple Intelligence. On-device processing handles most tasks, while Private Cloud Compute taps cloud resources for complex requests without storing or sharing user data. Independent experts can verify this commitment by inspecting the code running on Apple’s silicon servers, ensuring transparency.
Spatial Gallery and Beyond
visionOS 2.4 doesn’t stop at AI. The new Spatial Gallery app will showcase a curated collection of spatial photos, videos, and panoramas from artists, filmmakers, and brands like Cirque du Soleil and Porsche. Launching with content from photographers like Jonpaul Douglass and exclusive Apple Originals moments, Spatial Gallery aims to immerse users in art, culture, and nature, with regular updates to keep the experience fresh.
Complementing this is the Apple Vision Pro app for iPhone, rolling out with iOS 18.4 in April. This app simplifies device management, offering app downloads, curated content recommendations, and tips via a Discover page. Users can explore 3D movies, Apple Immersive titles like “Ice Dive” and “Sharks,” and Spatial Gallery highlights—all from their iPhone. The My Vision Pro page provides quick access to device info and Personalized Spatial Audio setup, enhancing user convenience.
Enhanced Features and Guest Access
visionOS 2.4 also brings practical upgrades. Smart Reply in Messages and Mail suggests quick responses, while Create a Memory Movie in Photos crafts narrative-driven slideshows from user descriptions. Natural language search simplifies finding media, and Priority Notifications keep users focused. Guest User enhancements allow sharing with nearby iPhone or iPad users, complete with app restrictions and AirPlay View Mirroring for guided experiences.
Availability and Impact
Apple Vision Pro, available in 14 regions including the U.S., UK, and Japan, will see these updates roll out globally. Spatial Gallery and the iPhone app will support most of these markets, with demos available at Apple Stores. As Mike Rockwell, Apple’s VP of the Vision Products Group, noted, “With Apple Intelligence, Vision Pro users will take productivity and creativity to new heights.” This update solidifies Apple’s leadership in spatial computing, blending innovation with intuitive design.
