AI task designer urges checks for loopholes in how tests are judged

A task designer argues that difficult tests for frontier AI models need checks for exploitable verifiers—the systems that judge success. The contributor says their team is sharing safeguards and design choices for cheating-resistant tasks, and points to an Anthropic post discussing the relationship between reward hacks and misalignment.