/AI21h ago

Anysphere co-founder Michael Truell launches Design Mode for Cursor, enabling UI editing through voice, drawing, and live gesturing

Story Overview

Cursor's Design Mode adds a visual layer to the AI agent's workflow inside its built-in browser, letting developers select rendered UI elements and issue changes that propagate back to the source code rather than staying limited to chat prompts.

4204.2K638600809.5K
Original post
Michael Truell@mntruell#506inAI

Working with agents should feel like working with a colleague. You should be able “speak to” them not just with text chats, but by gesturing at a screen together, talking live, etc.

10:50 AM · Jun 5, 2026 · 718.9K Views

A running local server remains required for the live preview

The feature loads the app via a standard dev command so the editor can inspect and alter DOM elements, component props, and visual styles in real time, yet it does not remove the need for an active local environment.

Voice and drawing inputs lack confirmation in primary sources

Posts circulating around the launch describe pointing, drawing, and speaking as interaction options, but Cursor's December 2025 announcement and subsequent changelog entries only document click-to-select plus text prompts, leaving the broader multimodal claims unverified.

Sentiment

Many users praised Cursor AI's new Design Mode for enabling intuitive point-draw-talk UI edits that make AI feel like a real colleague, while some objected to AI tools in general or expressed disappointment over unrelated missing features.

Pos
90.4%
Neg
9.6%
135 comments with sentiment.
Cluster Engagement
Posts from X
Most Activity
Most Activity
VIEWS42.2KLIKES1KRETWEETS81REPLIES126
Elon Musk@elonmusk

@mntruell 💯

Working with agents should feel like working with a colleague. You should be able “speak to” them not just with text chats, but by gesturing at a screen together, talking live, etc.

20hViews 42.2KLikes 1KBookmarks 18
BOOKMARKS138
Ryo Lu@ryolu_

designing in code is now as easy as: click, chat, hold shift to multi-select.

works best with Composer 2.5

15hViews 28KLikes 443Bookmarks 138

Working with agents should feel like working with a colleague. You should be able “speak to” them not just with text chats, but by gesturing at a screen together, talking live, etc.

21hViews 718.9KLikes 2.5KBookmarks 314
X CEO@XCEO_eth

@elonmusk @mntruell Grok Agents

20hViews 7Likes 2Bookmarks 1
X CEO@XCEO_eth

@mntruell Try Grok Agents

20hViews 26Likes 2
Maverick@Mavericks100xs

@elonmusk @mntruell Are you bullish on the $SPCX IPO @elonmusk

I know I am - cant wait for it!

20hViews 31Likes 2Bookmarks 1
Harshit Khemani@HarshitKhemani

@ericzakariasson can I build cursor with cursor? pt. 2

20hViews 26Bookmarks 1
Zaki@Zaki4lq

@elonmusk @mntruell 78K7QEC9HXgUoT7U19LRKHSJaZt6eMPDGMmxJJHNpump

20hViews 26Likes 1Bookmarks 1
ʏᴢ@YZfinance

@elonmusk @mntruell What do you think about QNX

20hViews 14Likes 3
Amrita Yadav@amrita4AI

@mntruell @elonmusk 👍

20hViews 18Likes 2
Jay Naidu@JayNaiduX

@mntruell @elonmusk We're still using AI like it's email.

The future probably looks more like Zoom.

20hViews 6Likes 1
Desye Black@DesyeBlackrw

@elonmusk @mntruell 💯

20hViews 1Bookmarks 1
Anthony@amfonte

@mntruell What version of cursor is this? Mine looks nothing like this nor does design mode work like this. 🙃

17hViews 52Likes 1
Isabella❣️@umar08984819398

That points toward a much more natural “co-working” model for AI agents 🤝

Instead of treating agents like tools you prompt, it’s closer to a shared workspace where you can point, highlight, ask in real time, and correct instantly—almost like screen-sharing with a teammate. That would reduce friction a lot compared to back-and-forth text and make complex tasks (design, coding, planning) feel more fluid and collaborative.

The big challenge is making that interaction precise and reliable—so the agent understands gestures, context on-screen, and live conversation without misinterpreting intent.

20hViews 23Likes 2
Volo@VoloBuilds

@mntruell This is why I'd love to see a duplex voice mode in Cursor. Back and forth conversation with an orchestrator that manages agents under the hood.

17hViews 21Likes 1
Leinona Aoki@LeinonaA69

@mntruell This is exactly how AI collaboration should feel — like a true colleague sitting next to you 🔥 Point, draw, talk… no more fighting with prompts. Cursor is cooking something special. Great work team!

20hViews 20Likes 1
Load more posts