Snorkel AI expands Open Benchmarks Grants tenfold to $30 million

Snorkel AI announced on October 7 that it was expanding its Open Benchmarks Grants tenfold to a $30 million commitment. It says the funding will support a more diverse, continuously updated set of open benchmarks, alongside a red team to test them and a fellowship for independent contributors developing evaluation methods. The announcement argues that benchmarks can become too simple or static as AI capabilities advance.