Siri in Vision OS: You can just look at the floating orb and start talking, and it'll start a conversation. Clever. Then it can also let you ask about real physical objects around you. Like Google Lens.
Users trigger hands-free Siri by looking at a floating orb
Siri in Vision OS: You can just look at the floating orb and start talking, and it'll start a conversation. Clever. Then it can also let you ask about real physical objects around you. Like Google Lens.
Positive users hail VisionOS eye-contact Siri and real-world object scanning as brilliant and intuitive, while negative users dismiss it as slow, limited to few users, or doomed like Google Glass.
Wow -- Visual Intelligence on visionOS for items you are looking at in the real world. I wonder what this is preparing for!

@MKBHD Can Siri do more than just set an alarm now?
This is cool, maybe the highlight of WWDC. Gaze and talk to AI

This gaze + context-aware Siri in VisionOS is brilliant — turning the floating orb into an intuitive, environment-aware collaborator that understands physical objects on the fly. It opens exciting doors for immersive neuro-adaptive learning and agentic AR workflows that blend digital intelligence with the real world seamlessly. How are you thinking of building educational or productivity experiences around this? 🚀

@markgurman It will good for the 10 people that have one

@Mrwhosetheboss Welcome to the Google Circle to search just a year later ! 😂

@markgurman But Apple Vision Pro is dead right? 😎

@MKBHD How I will be inside🤣

@markgurman They just need to sort the pricing out with visionOS and I think it could be huge in the future

@MKBHD Did they confirm if it’s powered by Gemini?

@Kappische @MKBHD Yeah

@markgurman Yeah, wow for the 10 people that actually uses one.

@Kappische @MKBHD It can’t even set an alarm rn lol

@markgurman

@markgurman

@MKBHD I love that you don't have to say "Hey Siri" anymore

@MKBHD The real innovation isn't that Siri can see objects.
It's that we're finally moving from "apps you open" to "assistants that understand the world around you."
The interface is slowly disappearing. 🤯

@MKBHD I’d rather Siri work better on HomePod. Surely more people have HomePods than Vision Pro…

@markgurman A dystopian cocktail of Ready Player One, and Cyberpunk 2077. Just off the top of my head.

@Mrwhosetheboss Circle to search with your actual eyeballs 😂💀 Apple really said forget the finger just look at it 🔥 Vision Pro is getting scary useful now
Users trigger hands-free Siri by looking at a floating orb
Siri in Vision OS: You can just look at the floating orb and start talking, and it'll start a conversation. Clever. Then it can also let you ask about real physical objects around you. Like Google Lens.