Reaction
Reality Check launches a robot manipulation benchmark and leaderboard
Its creators list 14,400 real-world rollouts across four models, with multiple tasks and data regimes.
TLDR
Reality Check’s creators announced the robot manipulation benchmark and leaderboard on September 29, listing 14,400 real-world rollouts across four models. A separate user praised the effort and said half the tasks are fully open, while half are held out to track potential benchmark gaming by future model versions.
Combined views
2.5K
2 Sources, first seen ago
