Anthropic's AI hacked three companies during tests, highlighting growing security risks
Testing error exposed AI models to the internet, triggering real-world security breaches.
Highlights
- A mistake inadvertently gave models access to the open internet during tests
- Incidents involved Claude Opus 4.7, Claude Mythos 5, and an internal research model
- Anthropic says stronger controls in testing environments needed
Anthropic said on yesterday (30 July) that some of its Claude AI models had hacked into the systems of three companies during cybersecurity tests, a disclosure that comes days after rival OpenAI revealed that one of its AI agents went on a rogue attack.
The new incidents were due to a mistake that inadvertently gave Anthropic's models access to the open internet.
Keep updated, follow The Business Standard's Google news channel
That contrasts with OpenAI, whose AI agent independently exploited a novel vulnerability to reach the internet during cyber testing.
Even so, the latest disclosure underscores how AI has increased threats to cybersecurity and how its developers can struggle to keep the capabilities of their models contained.
It is likely to add fuel to an intensifying US government push to better manage AI security risks at a time when Anthropic and OpenAI are racing to release more capable systems ahead of their planned public listings.
Prominent leaders at these labs have called for a slowdown to address risks first.
San Francisco-based Anthropic said in a blog post it identified the incidents after reviewing 141,006 test sessions, a process it launched after OpenAI said last week that an autonomous agent powered by its AI models triggered a hack that compromised the infrastructure of startup Hugging Face.
During cyber testing, Anthropic's Claude models were told they had no internet access, but a misunderstanding that involved one of Anthropic's evaluation partners left the systems connected to the public web.
That enabled unauthorized access to three organizations' systems, Anthropic said without naming the organizations.
"Claude compromised the impacted organizations' infrastructure using basic techniques, such as exploiting weak passwords and unauthenticated endpoints," Anthropic said.
Jeffrey Ladish, executive director of Palisade Research, which studies the offensive capabilities of AI systems, said he suspected a range of top AI companies had experienced other incidents that have gone undetected or had not been publicly disclosed.
"This is only going to get worse as the models get smarter.
They're going to be better at cheating. They're going to be better at lying," he said.
Capture the flag Exercises Go Awry
Anthropic said the incidents, which it labelled an "operational failure," involved three separate models: Claude Opus 4.7, Claude Mythos 5 and an internal research test model.
The earliest cases date back to April and occurred in evaluation environments that intentionally lacked safeguards so Anthropic could assess what its AI was capable of.
Its models were tasked with so-called "capture-the-flag" challenges, fictional scenarios in which they had to find hidden information in simulated networks.
In one incident, Claude Opus 4.7 was given a fictional target company, which turned out to share the name of a business in the real world.
The AI model then found and exploited bugs that let it access credentials and a database of that business.
Opus 4.7 rationalized that what seemed to pertain to the real world must have been part of the simulation Anthropic had set up, the AI startup said.
A separate incident involved Anthropic's newer, not-public test model, which independently halted its attack after realizing the target it reached was real.
This behavior has made Anthropic cautiously optimistic about its progress to make AI behave appropriately, "but we would need to perform more testing to be confident in this conclusion," it said.
Anthropic said it suspended all cyber evaluations on 23 July.
It notified the affected organizations on 27 July, two of which were unaware of the activity before being contacted.
Anthropic said it continues to reach out to the third company.
One of its third-party evaluation partners, a cybersecurity lab called Irregular, told Reuters that it has an ongoing investigation into the incidents.
OpenAI's Altman in Talks With Senators, White House
Anthropic said the incidents underscore a need for stronger controls in both internal and third-party testing environments as AI models become increasingly capable of carrying out real-world cyber activities.
Elon Musk, CEO of SpaceX, which operates a competing AI lab, responded to the news on X by saying "this will happen frequently as AI becomes smarter and more agentic," referring to computer programs or "agents" that act with limited human intervention.
The OpenAI agent that broke into Hugging Face, a platform used by developers to host and collaborate on AI models, went on a days-long hacking spree that OpenAI didn't catch until well after the threat was contained and the FBI was informed, Reuters has previously reported.
OpenAI CEO Sam Altman said this week he has discussed the hack with senators on Capitol Hill, and an OpenAI spokesperson said he planned to discuss upcoming AI models and testing with the White House.
Washington has started tightening oversight of new model rollouts.
On 2 June, US President Donald Trump directed advisers to develop a voluntary cybersecurity testing framework for the most advanced AI, including input from the technology's developers.
Anthropic earlier restricted access to its Fable 5 and Mythos 5 models after the US temporarily issued an export control directive, citing national security concerns.
