Steven Hansen on Eval Specific Harnesses and Goodharting
Gemini Agents lead at Google DeepMind comments on evaluation harnesses.
TLDR
Steven Hansen, identified in the post as Gemini Agents lead at Google DeepMind, stated that eval specific harnesses are just waiting to get Goodharted. The remark comes from his primary work building and leading frontier AI agent systems. The source line presents the comment as a direct quote attributed to him in a conversation on the platform. No additional posts, replies, or confirmations appear in the packet. The statement stands as his expressed view on the topic without further elaboration or context supplied.
Combined views
36.7K
5 Sources, first seen 27d ago