OpenAI has rolled out an exciting new application for the Apple Vision Pro headset, the ChatGPT app, integrating the advanced GPT-4 Turbo model. This app not only marks a significant advancement in artificial intelligence, but also revolutionizes the way users interact with technology through augmented reality (AR).
The app allows users to communicate with AI using voice commands, text, and visual inputs directly through the Vision Pro headset.
The ChatGPT app on Vision Pro is designed to transform user interaction with AI, enabling users to solve real-world problems, seek information, and learn in innovative ways.
Users can dictate queries, showcase issues via the headset’s camera, and receive answers in an intuitive manner.
chat has now entered the 3D world.
you can find it in the visionOS App Store. pic.twitter.com/TethfMEc9j
— ChatGPT (@ChatGPTapp) February 2, 2024
This capability is particularly useful for a range of tasks including troubleshooting, meal planning, and educational pursuits.
This app is a key addition to visionOS, the operating system for Apple Vision Pro, leveraging its unique features such as Optic ID for secure biometric authentication, Spatial Audio for immersive sound experiences, and VisionKit for enhanced app development.
While the specifics of how these technologies are utilized are yet to be fully disclosed, they hint at a future where AI interactions are enriched through a combination of text, voice, and visual inputs.
With its multimodal AI capabilities, the ChatGPT app for Vision Pro stands out by processing various types of inputs including text, voice, images, and videos. This flexibility makes it an invaluable tool for a wide range of applications, from diagnosing mechanical faults to planning meals based on what you have in your fridge.
Available for free on the visionOS App Store, the ChatGPT app also offers a premium subscription called ChatGPT Plus, which provides users with access to more advanced features and quicker response times from the GPT-4 model.
With over 600 apps available on the App Store, Vision Pro users are guaranteed a diverse and enriching ecosystem, further enhancing the AR experience.