Meta AI Benchmarks Face Scrutiny Over Designer Ties and Model Shortfalls
A conversation on X is questioning whether Meta's benchmark win says much when critics say one of the headline tests was designed by Meta AI's own lead.
In a widely shared post on X, one critic argued that Meta's Muse Spark 1.1 benchmark splash deserves a closer look because "the head of meta ai designed humanity's last exam," while the comparison image attached to the post appears to show the model trailing rivals on some coding benchmarks. Andrew Curran wrote on X that readers should look at Mark Zuckerberg's announcement of Muse Spark 1.1 and the benchmark table behind the debate.
Combined views
21K
5 posts, first seen 3h ago
Combined views
21K
5 posts, first seen 3h ago