1d ago

Amazon shuts down an internal AI adoption leaderboard after employees gamed the system to inflate usage metrics

Anthropic previously rejected building a similar token-maximizing leaderboard

——0——
Original post
OPGary Marcus, MIT PhD and NYU Professor Emeritus#153Gary Marcus, MIT PhD and NYU Professor Emeritus@GARYMARCUS

tokenmaxxing is officially over

3:05 PM · May 28, 2026 View on X
REPLYCarlos E. Perez#1598Carlos E. Perez@INTUITMACHINE

@GergelyOrosz Yeah, leaderboards seem to be an anti-pattern!

Gergely OroszGergely Orosz@GergelyOrosz

I can now probably say this: Two months ago, inside Anthropic someone suggested building a token leaderboard. A heated internal debate followed and the decision was made to *never* ever do it… because several people inside Anthropic simply thought ahead of the consequences

8:25 AM · May 29, 2026 · 1.1M Views
4:06 PM · May 29, 2026 · 636 Views
QUOTE POSTEthan#1884Ethan@TORCHCOMPILED

Humans are more guilty of reward hacking than AI at this point.

2:44 PM · May 29, 2026 · 1.5K Views
Amazon shuts down an internal AI adoption leaderboard after employees gamed the system to inflate usage metrics · Digg