Apple unveils Siri AI featuring onscreen visual intelligence, personal context synthesis, and cross-app action capabilities
AI Judge changed title after evaluation, original title: "Apple rolls out Siri updates featuring onscreen awareness, personal context, and in-app actions"
Demonstrations featured realistic processing delays during multi-step queries.
Positive users praise Apple's upgraded Siri with context awareness and image understanding as an exciting overdue upgrade while negative users dismiss the AI features as mediocre and call Siri Apple's worst product.
Most Activity
The demos of Siri AI are very grounded in personal context. So you can talk to Siri and bring in real-world knowledge, but it also finally does the things you'd expect: Searches your messages, contacts, Maps history, etc. And it can take actions in these same places: Add photos to albums, send iMessages, add events to calendar, add reminders, etc. Good baseline stuff.
The next generation of Apple Intelligence powers an entirely new Siri: making the apps and experiences you rely on across iPhone, iPad, Mac, and Apple Vision Pro more personal and helpful than ever.
The gag here with this Siri demo is that Rockwell is showing use case after use case that should have worked for the last decade -- only for them to actually work this time. Huge win.
Apple WWDC just demo’d new Siri AI powered by Apple Intelligence (aka Gemini distillation).
It’s supposed to be more conversational with on-screen visual intelligence and can integrate user context (photos, contacts, calendars).
The WWDC 2024 version was pure vapourware but this looks more legit because Siri responses actually take a while to respond. After getting fined last time for false advertising, Apple can’t mess around with this Siri update.
Interesting: New Apple Intelligence Siri only available on iPhone 17 Pro.
Of course not be available in the EU (god damn)
Apple Intelligence sounds like a very good update. But did I miss all the relevant (nerd) stuff like paramters, evals in benchmarks and what not? Hopefully on their website
Apple Intelligence sounds like a very good update. But did I miss all the relevant (nerd) stuff like paramters, evals in benchmarks and what not? Hopefully on their website
- System wide awareness - Visual Intelligence in Camera App
Siri update
- image understanding - more conversational - reworked voice-tone / sound. Sounds real human
Apple Intelligence:
-Personal Understand in apps. - Browse tools for web - on screen Awareness - in App usage
- System wide awareness - Visual Intelligence in Camera App
Siri update
- image understanding - more conversational - reworked voice-tone / sound. Sounds real human
Siri AI with on-screen “visual intelligence” when someone opens an incognito Safari browser, lowers the screen brightness and mutes the volume on their iPhone 17 Pro Max
Apple WWDC just demo’d new Siri AI powered by Apple Intelligence (aka Gemini distillation).
It’s supposed to be more conversational with on-screen visual intelligence and can integrate user context (photos, contacts, calendars).
The WWDC 2024 version was pure vapourware but this looks more legit because Siri responses actually take a while to respond. After getting fined last time for false advertising, Apple can’t mess around with this Siri update.
I’ll have plenty more to say about Apple’s new Siri AI in tomorrow’s newsletter, but here’s a quick hands-on demo of Siri in action
@MKBHD I feel like we are watching a keynote that should have been here 3 years ago tbh.
Siri AI, explained
Apple WWDC just demo’d new Siri AI powered by Apple Intelligence (aka Gemini distillation).
It’s supposed to be more conversational with on-screen visual intelligence and can integrate user context (photos, contacts, calendars).
The WWDC 2024 version was pure vapourware but this looks more legit because Siri responses actually take a while to respond. After getting fined last time for false advertising, Apple can’t mess around with this Siri update.
new siri are fine. looks like it will be a legit useful upgrade and i'll make huge use of agentic search over my own text messages. upgraded voice transcription might kill a few startups. but it's also just... exactly the minimal shit they should have fuckin launched in 2024.
Steve Jobs finding out that the new Siri AI features — 16 years after he acquired the company — are a calendar reminder, photo finder and contact list search
Apple WWDC just demo’d new Siri AI powered by Apple Intelligence (aka Gemini distillation).
It’s supposed to be more conversational with on-screen visual intelligence and can integrate user context (photos, contacts, calendars).
The WWDC 2024 version was pure vapourware but this looks more legit because Siri responses actually take a while to respond. After getting fined last time for false advertising, Apple can’t mess around with this Siri update.
@MKBHD why does this guy look like the adoring fan from oblivion
@tim_cook Not coming to the EU is a massive fail!
@ijustine Hope it actually works
@MKBHD
google and apple both still bafflingly behind in product here. what is going on?
@MKBHD All the WWDC invites ever
https://sheets.works/data-viz/wwdc-invites