Researchers say general coding agents beat hand-designed data agents
A study author reports an advantage of up to 37 points, with 4× fewer turns—and asks what systems researchers still need to solve as models improve.
TLDR
A study author says the team examined how data-agent capabilities evolved over two years, finding that general coding agents beat hand-designed data agents by up to 37 points, with 4× fewer turns. Sharing the paper, the author argues that those gains still leave problems for systems researchers to solve.
Combined views
18.6K
6 Sources, first seen 23d ago