RoboArena Updates Rules and Rolls Back Evals After Benchmark Hacking

As it happens i took a screenshot of the leaderboard last weekend for a blog post, so if you want to know what got dropped, you can check here (Spirit is still on top!)

Unfortunately I worry this sort of thing will make it less likely big companies compete on these benchmarks. But then, the whole point is that benchmarks are how you figure out which models to use -- and I probably would not seriously consider e.g. Spirit if not for this one.

The blog post is here but it's only okay https://itcanthink.substack.com/p/what-do-robotics-leaderboards-tell

@JieWang_ZJUI Cosmos3 was removed from the leaderboard. It's crazy to see that NVIDIA would do something like this.