Reaction
The challenge of building AI benchmarks from human tasks
A post argues that human tasks are now too easy to use as AI benchmarks in many domains.
TLDR
The author says human tasks could be turned into benchmarks when AI was at human level. In many domains, those tasks are now too easy, the post argues, and it introduces guidelines for building benchmarks in this new era.
Combined views
—
1 Source, first seen ago