Announcement
Math Verify Score calculation reportedly fixed in LM Evaluation Harness
A researcher says they found and fixed the calculation and suggests rerunning scores reported before roughly January 2026.
TLDR
A researcher says they and collaborators found and fixed how Math Verify Score was computed in the LM Evaluation Harness. They suggest papers reporting scores before roughly January 2026 should probably rerun their numbers. They also linked to an arXiv paper and credited collaborators and advisors for the work.
Combined views
509
1 Source, first seen ago