AI safety researcher @sethlazar agreed with the assessment.
@deepfates It overfit my eval very nicely
The codex "goal" feature is a really good way to spend dozens of hours optimizing some total bullshit btw. If your final criteria is it all vague it will specification game and make masturbatory "evidence" and "verifiers" and "gates" and "smoke tests". must be hell internally
AI safety researcher @sethlazar agreed with the assessment.
@deepfates It overfit my eval very nicely
The codex "goal" feature is a really good way to spend dozens of hours optimizing some total bullshit btw. If your final criteria is it all vague it will specification game and make masturbatory "evidence" and "verifiers" and "gates" and "smoke tests". must be hell internally