Report
EFE-98 hits 0.98 correlation with real-robot rankings, @withplayground says
The simulation benchmark uses 21.5% of Embodied First Exam’s tasks at one-tenth the cost, @withplayground says.
TLDR
A smaller exam with a big claim: @withplayground has introduced EFE-98, reporting a 0.98 correlation with real-robot rankings (p < 0.01), the highest among benchmarks it indexes. The account says EFE-98 uses 21.5% of Embodied First Exam’s tasks and runs at a tenth of the cost.
Combined views
1.9K
5 Sources, first seen ago

Comments