Porting Agents’ Last Exam’s Linux CLI subset to Verifiers v1
The author of a new blog post says they found issues in the frontier benchmark’s data during their explorations at a Prime residency.
TLDR
A blog author shared a write-up about porting the Linux command-line (CLI) subset of Agents’ Last Exam to Verifiers v1, saying they found issues in the benchmark’s data. They describe the work as part of their Prime residency explorations and credit a collaborator who served as their verifier.
Combined views
30
1 Source, first seen ago