UC Berkeley's Jason Lee argues AI GUI navigation is highly inefficient compared to human operators
Founder Bojan Tunguz leverages their persistence for tedious background tasks
No Digg Deeper questions have been answered for this story yet.
Most Activity
That’s true, but what it lacks in efficiency it more than makes up in terms of dogged persistence. The GUI tasks I let it work on are those that I find too tedious and don’t need an immediate solution for.
Watching codex or Claude Cowork use the gui is excruciating. Good to know we are still better at something (by a lot)
@kohjingyu Basically it's trying to delete some junk in my context menu (the right click menu) which is pretty hard to verify you did correctly w/o actually looking at the menu
@jasondeanlee What are you getting it to do that you can't with code/APIs?
@jasondeanlee What are you getting it to do that you can't with code/APIs?
Watching codex or Claude Cowork use the gui is excruciating. Good to know we are still better at something (by a lot)
@jasondeanlee That's really interesting, we did notice on some computer use evals that Anthropic models switch to bash any chance they get
@kohjingyu I told it try and use terminal as much as possible but it still goes with gui
@kohjingyu I told it try and use terminal as much as possible but it still goes with gui
@jasondeanlee What are you getting it to do that you can't with code/APIs?
Actually more like 15 or 20 min. It's still going I incorrectly thought it finished...
Watching codex or Claude Cowork use the gui is excruciating. Good to know we are still better at something (by a lot)