/AI5h ago

Apple brings Visual Intelligence to visionOS, enabling Vision Pro users to query real-world objects using eye tracking and Siri

Story Overview

Apple is extending Visual Intelligence into visionOS so Vision Pro users can stare at real-world items and ask Siri practical questions about them, with the system pulling camera data to deliver answers like volume checks or product specs overlaid in space.

1065.3K15198301.3K
Original post
Marques Brownlee@MKBHD#1416inAI

Siri in Vision OS: You can just look at the floating orb and start talking, and it'll start a conversation. Clever. Then it can also let you ask about real physical objects around you. Like Google Lens.

10:49 AM · Jun 8, 2026 · 203.2K Views
Developer Impact

Eye tracking turns surroundings into instant queries

The feature uses gaze detection plus the headset cameras to identify objects and run calculations, mirroring earlier iOS tools but now anchored in a floating orb interface that responds to natural eye contact.

Open Question

Fall arrival leaves rollout questions open

visionOS 27 brings the capability later this year, yet specifics on beta access, supported languages, or any phased release remain unstated in current announcements.

Sentiment

Many users praised Apple's Vision Pro eye-activated Siri and real-world object scanning in VisionOS as a natural spatial-computing breakthrough, while others dismissed the features as niche or currently too limited.

Pos
63.4%
Neg
36.6%
38 comments with sentiment.
Cluster Engagement
Posts from X
Most Activity
Most Activity
VIEWS1.5KLIKES10REPLIES6
Kaplan@Kappische

@MKBHD Can Siri do more than just set an alarm now?

5hViews 1.5KLikes 10
RETWEETS2
Rise-Raise@rise_raise_ai

This gaze + context-aware Siri in VisionOS is brilliant — turning the floating orb into an intuitive, environment-aware collaborator that understands physical objects on the fly. It opens exciting doors for immersive neuro-adaptive learning and agentic AR workflows that blend digital intelligence with the real world seamlessly. How are you thinking of building educational or productivity experiences around this? 🚀

5hViews 81Likes 2
Alex Volkov@altryne

This is cool, maybe the highlight of WWDC. Gaze and talk to AI

5hViews 753Likes 5Bookmarks 0
Anthony@Tweetmusky

@markgurman It will good for the 10 people that have one

5hViews 522Likes 3

@Mrwhosetheboss Welcome to the Google Circle to search just a year later ! 😂

5hViews 333Likes 1
Drip Father@Drip_Father

@MKBHD How I will be inside🤣

5hViews 627Likes 4
P D@parallel69_paul

@markgurman They just need to sort the pricing out with visionOS and I think it could be huge in the future

4hViews 293
PhantomArc@PhantomArc_

@MKBHD Did they confirm if it’s powered by Gemini?

5hViews 118
necondaa@necondaa007

@Kappische @MKBHD Yeah

5hViews 115
M Vice@nils56250

@markgurman Yeah, wow for the 10 people that actually uses one.

5hViews 360
CT@pvstarop

@Kappische @MKBHD It can’t even set an alarm rn lol

5hViews 106Likes 4
Antron@AntronNYC

@markgurman

5hViews 300Likes 3
Tech Egbon@Tech_Egbon

@MKBHD I love that you don't have to say "Hey Siri" anymore

5hViews 911
Sai Agastya@SaiAgastya11

@MKBHD The real innovation isn't that Siri can see objects.

It's that we're finally moving from "apps you open" to "assistants that understand the world around you."

The interface is slowly disappearing. 🤯

5hViews 284Likes 1
Krahnin@Krahnin

@MKBHD I’d rather Siri work better on HomePod. Surely more people have HomePods than Vision Pro…

5hViews 733
Zack Smith@ZackOftheTrades

@markgurman A dystopian cocktail of Ready Player One, and Cyberpunk 2077. Just off the top of my head.

5hViews 197Likes 1

@Mrwhosetheboss Circle to search with your actual eyeballs 😂💀 Apple really said forget the finger just look at it 🔥 Vision Pro is getting scary useful now

5hViews 154Likes 1

The most interesting thing about voice interfaces is not the convenience. It is what happens when the barrier to asking questions drops to zero. Students who would never type a question will speak one. The next generation of learning tools will not have keyboards. They will have conversations. That is the interface education has been waiting for.

4hViews 364
Load more posts