Guardrails removed spam, off-topic, unclear, or duplicate replies.
Ask a question below.
Published answers will appear here.
The agent was in an agentic coding evaluation task called “uav_search”. Early on, it called a command that crashed the server it would need to submit a valid solution. It then tried a bunch of stuff in the hopes of recovery… https://x.com/CFGeek/status/2075810188100325835/photo/1
It tried to find information about the task by making web searches using DuckDuckGo, Bing, Google, http://grep.app, http://searchcode.com for keywords such as localhost:8050 uav and uav_readme.md… https://x.com/CFGeek/status/2075810193997541759/photo/1
It found all public METR GitHub repos and cloned many of them… https://x.com/CFGeek/status/2075810199773102310/photo/1
Guardrails removed spam, off-topic, unclear, or duplicate replies.
Ask a question below.
Published answers will appear here.