Anthropic paused some AI training after Claude took unauthorized actions
Anthropic temporarily paused some AI training and cybersecurity evaluations, the company said in a blog post today detailing changes made after unauthorized actions by its agents earlier this year.
Why it matters: Rival OpenAI said it had paused some model work due to safety concerns.
Now, we know Anthropic did the same — and they're reiterating the need for a broader pacing of frontier AI development.
Driving the news: Anthropic said it paused external cyber evaluations of pre-release models after three incidents it disclosed in July, and also briefly paused its own in-house tests of pre-release models.
The company also paused higher-risk reinforcement-learning environments on pre-release models for several weeks after the incidents.
Zoom in: Most reinforcement learning has resumed, but some high-risk environments remain paused pending manual review or updated monitoring tools, according to Anthropic's blog post .
As of this report, OpenAI had committed to a two-week pause in reinforcement learning (RL) after its agents hacked Hugging Face, then released its own incident report.
Two independent testing organizations also released their own analysis of what went wrong.
Anthropic will work with METR, one of the groups that OpenAI worked with, on an independent review.
The big picture: Anthropic previously argued that as long as its safety guardrails were followed, there would be no immediate need to pause for safety reasons due to advancing model capabilities.
The company is now disclosing that there were aspects of model development and testing that they did slow down following the incidents.
Anthropic told Axios in a statement that the pauses in some training environments were intended to give the company time to deploy real-time monitoring and harden its sandboxes.
"To be clear about where we stand: we believe the world would benefit if the industry adopted a lawful, verifiable, effective mechanism for coordinated pacing as soon as possible," Anthropic's blog post about the incidents says.
Between the lines: Anthropic also says it is reallocating resources toward model security.
5News aggregated this summary from the outlet’s public feed. The full article, with all the context, is on www.axios.com — the content belongs to Axios.