Snorkel AI expands Open Benchmarks Grants tenfold to a $30 million commitment

Snorkel AI announced a tenfold expansion of its Open Benchmarks Grants to a $30 million commitment. It says the expansion will support more diverse, continuously updated open benchmarks, a red team to test them and a fellowship for contributors developing new evaluation methods. A later post about the expansion argues that independently developed benchmarks can help prevent “benchmaxxing,” while noting that private benchmarks and ongoing evaluations also matter.