Tasks resisting standardized metrics will retain long-term economic scarcity
Excellent essay. "The valuable work is illegible by construction: anything you can put on a leaderboard, you can train against, so anything measurable is already on its way to commodity."
Insights in every paragraph.
http://x.com/i/article/2064509889708507136
Users express gratitude to @ramez for the essay arguing that AI leaderboards accelerate commoditization of measurable work.
@ramez 🙏
Excellent essay. "The valuable work is illegible by construction: anything you can put on a leaderboard, you can train against, so anything measurable is already on its way to commodity."
Insights in every paragraph.
Tasks resisting standardized metrics will retain long-term economic scarcity
Excellent essay. "The valuable work is illegible by construction: anything you can put on a leaderboard, you can train against, so anything measurable is already on its way to commodity."
Insights in every paragraph.
http://x.com/i/article/2064509889708507136