Apple’s Vision Pro hardware, last updated in the fall with an M5 chip, is getting new software upgrades with the latest version of VisionOS announced at WWDC. A big one is Visual Intelligence, camera-aware AI, at long last.
As part of Apple’s new Siri-focused AI updates announced at this year’s conference, it’s the Vision-focused AI tools that interest me most. Asking Siri will see things on apps you have open on VisionOS, but also recognize things in the room.
This is the same type of camera-aware AI that Google and Samsung already have in the Samsung Galaxy XR headset that arrived last fall.
Apple also announced a tool that converts panoramic photos in 3D spatial scenes that can become new immersive backgrounds in VisionOS.
While many people have been reporting the Vision Pro’s life ending in the face of a shift to smart glasses in the next few years, the Vision Pro’s hardware can clearly do things no glasses could dream of anytime soon. I’ve been waiting for Apple’s spatial computer to make the most of its processing power, sensors, and high price tag. Maybe these updates will help.
This is a developing story, we’ll update as more is announced.
