Anthropic wants officials to seek court orders blocking AI model releases found to pose a serious public risk

Reuters reports that, in an October 15 letter to California Governor Gavin Newsom, Anthropic proposed letting government officials seek court orders to block the release of AI models found to pose a serious risk to the public. The company said model-wide “kill switches” could give officials a false sense of reassurance and favored disabling a problematic AI agent or cutting off a specific customer's access instead. Politico first reported the letter's details.