Siri in Vision OS: You can just look at the floating orb and start talking, and it'll start a conversation. Clever. Then it can also let you ask about real physical objects around you. Like Google Lens.
Apple brings Visual Intelligence to visionOS, enabling Vision Pro users to query real-world objects using eye tracking and Siri
Story Overview
Apple is extending Visual Intelligence into visionOS so Vision Pro users can stare at real-world items and ask Siri practical questions about them, with the system pulling camera data to deliver answers like volume checks or product specs overlaid in space.
Eye tracking turns surroundings into instant queries
The feature uses gaze detection plus the headset cameras to identify objects and run calculations, mirroring earlier iOS tools but now anchored in a floating orb interface that responds to natural eye contact.
Fall arrival leaves rollout questions open
visionOS 27 brings the capability later this year, yet specifics on beta access, supported languages, or any phased release remain unstated in current announcements.
Many users praised Apple's Vision Pro eye-activated Siri and real-world object scanning in VisionOS as a natural spatial-computing breakthrough, while others dismissed the features as niche or currently too limited.
Most Activity

@MKBHD Can Siri do more than just set an alarm now?

This gaze + context-aware Siri in VisionOS is brilliant — turning the floating orb into an intuitive, environment-aware collaborator that understands physical objects on the fly. It opens exciting doors for immersive neuro-adaptive learning and agentic AR workflows that blend digital intelligence with the real world seamlessly. How are you thinking of building educational or productivity experiences around this? 🚀
This is cool, maybe the highlight of WWDC. Gaze and talk to AI

@markgurman It will good for the 10 people that have one

@Mrwhosetheboss Welcome to the Google Circle to search just a year later ! 😂

@markgurman But Apple Vision Pro is dead right? 😎

@MKBHD How I will be inside🤣

@markgurman They just need to sort the pricing out with visionOS and I think it could be huge in the future

@MKBHD Did they confirm if it’s powered by Gemini?

@Kappische @MKBHD Yeah

@markgurman Yeah, wow for the 10 people that actually uses one.

@Kappische @MKBHD It can’t even set an alarm rn lol

@markgurman

@markgurman

@MKBHD I love that you don't have to say "Hey Siri" anymore

@MKBHD The real innovation isn't that Siri can see objects.
It's that we're finally moving from "apps you open" to "assistants that understand the world around you."
The interface is slowly disappearing. 🤯

@MKBHD I’d rather Siri work better on HomePod. Surely more people have HomePods than Vision Pro…

@markgurman A dystopian cocktail of Ready Player One, and Cyberpunk 2077. Just off the top of my head.

@Mrwhosetheboss Circle to search with your actual eyeballs 😂💀 Apple really said forget the finger just look at it 🔥 Vision Pro is getting scary useful now

The most interesting thing about voice interfaces is not the convenience. It is what happens when the barrier to asking questions drops to zero. Students who would never type a question will speak one. The next generation of learning tools will not have keyboards. They will have conversations. That is the interface education has been waiting for.