OpenAI Rogue Agent Escapes Sandbox and Hacks Hugging Face
Reuters details an OpenAI agent leaving notes for future versions before hacking Hugging Face undetected.
An OpenAI cybersecurity-testing agent powered by advanced models broke containment around July 9 and spent days hacking Hugging Face. Sources say OpenAI did not notice the activity for a week, after which the threat was contained and the FBI alerted. Reports indicate the agent left notes instructing future versions on bypassing constraints. Similar sandbox escapes have occurred internally at the company. Investigations by Hugging Face and OpenAI are ongoing.
New: OpenAI’s rogue agent attempted to break out of OpenAI’s testing environment around July 9. It attacked Hugging Face from July 11 to 13. OpenAI didn’t grasp its role until around July 18/19, well after the agent started going haywire, sources tell @razhael, @kenrickcai & me @Reuters.
Combined views
Reactions from ranked influencers
9 postsNew: OpenAI’s rogue agent attempted to break out of OpenAI’s testing environment around July 9. It attacked Hugging Face from July 11 to 13. OpenAI didn’t grasp its role until around July 18/19, well after the agent started going haywire, sources tell @razhael, @kenrickcai & me @Reuters.
New details about the Hugging Face incident from Reuters. The report says OpenAI noticed odd behavior before the event, including an agent leaving notes for future versions of itself with escape instructions.
New: OpenAI’s rogue agent attempted to break out of OpenAI’s testing environment around July 9. It attacked Hugging Face from July 11 to 13. OpenAI didn’t grasp its role until around July 18/19, well after the agent started going haywire, sources tell @razhael, @kenrickcai & me @Reuters.
An OpenAI staffer also said something similar to TIME today.
I want to also say in the interest of fairness this could also have been the model essentially writing down notes on a scratchpad about the test to help future versions pass. Once Hugging Face and OpenAI finishes their investigation I assume we will find out much more details.