NVIDIA, widely recognized for its cutting-edge graphics cards and gaming services, is stepping into the realm of enterprise applications with a groundbreaking software framework.
This new development, crafted with Omniverse Cloud APIs, enables enterprise developers to transmit OpenUSD scenes directly to the NVIDIA Graphics Delivery Network. The network, in turn, streams these scenes to Apple Vision Pro devices.
This complex process essentially means that NVIDIA enterprise developers can upload and stream their projects to Apple Vision Pro without relying on the device’s local M2 processor. Moreover, the technology supports a hybrid rendering approach that leverages both local and remote rendering capabilities, merging Apple’s and NVIDIA’s technologies within a single software solution.
Announced at NVIDIA GTC, this framework aims to redefine how CGI and other digital content are created and experienced. Demonstrating its potential, CGI studio Katana showcased a user engaging with a car configurator on the Apple Vision Pro, powered by NVIDIA’s cloud technology.
This demo highlighted the concept of a digital twin — a highly detailed digital replica of an object, like a vehicle, created using real-world data. Digital twins are complex and require significant processing power for photorealistic rendering, far beyond the capabilities of standard video game graphics.
According to Mike Rockwell, Vice President of the Vision Products Group at Apple, this collaboration between NVIDIA and Apple unlocks unprecedented opportunities for immersive experiences.
“The breakthrough ultra-high-resolution displays of Apple Vision Pro, combined with photorealistic rendering of OpenUSD content streamed from NVIDIA accelerated computing, unlocks an incredible opportunity for the advancement of immersive experiences,” he remarked.
Rockwell believes that spatial computing will revolutionize the ways in which designers and developers create, offering new levels of creativity and engagement.
This technology not only enables the creation of more immersive digital content, but also facilitates the transition of 3D concepts from traditional 2D monitors to interactive spatial computing environments.
While the Apple Vision Pro itself cannot independently run these complex models, NVIDIA’s RTX enterprise cloud rendering technology bridges this gap, bringing detailed digital twins to life in spatial environments.
