Fable 5.1 Hits High ARC-AGI Scores at Lower Cost
ARC Prize shares performance metrics for AnthropicAI's latest model version.
TLDR
The ARC Prize account posted that Fable 5.1 from AnthropicAI scored 90.0 percent on ARC-AGI-2 at 3.12 dollars per task and 97.5 percent on ARC-AGI-1 at 1.40 dollars per task. The post states the average cost per task across both benchmarks fell 32 percent from Fable 5 because of better token efficiency. An attached dark-themed scatter plot displays the ARC-AGI 2 leaderboard.
Combined views
122.3K
4 Sources, first seen 29d ago