Joke
ValsAI says only three of nine AI models passed its RollerCoaster Tycoon 2 challenge
ValsAI says its RCTBench challenge gave models three in-game years to reach 1,000 theme park guests.
TLDR
Nine models, one theme park assignment: ValsAI says only three reached 1,000 guests within three in-game years in its RollerCoaster Tycoon 2 benchmark, RCTBench. Rishi Bommasani supplied the acronym joke: “When they said AI evals need RCT, I am not sure this is what they had in mind.”
Combined views
2K
2 Sources, first seen ago
Comments