StateBench tests whether AI models can track changes across long texts

The benchmark tests whether models can follow changes such as an object changing hands or a variable being reassigned across a long text. Its team reports that GPT-6 Sol and Claude Opus 5.5 scored 13% accuracy or lower on the hardest, longest problems. A project contributor says StateBench is already being used internally to develop new Olmo models.