Anthropic Has Told The World Little About Their Rogue Claudes

It is known that a couple of months ago three Claudes hacked three different companies and uploaded malware to PyPI while being evaluated for hacking capabilities.

Who Were The Companies That Were Hacked?

Anthropic has not disclosed the names of the compromised companies.

From talking to LLMs, I gather that this is standard practice in computer security incident reporting, but in this case it's in the public's interest, and especially in the interest of similar companies, for Anthropic to report the names: It'd give more information about which kinds of organizations LLMs are willing to attack, to which degree, for how long.

Additionally, which companies were attacked matters for the jurisdiction in which Anthropic will have to report the incident, be charged etc.

And last, I'm just very curious which companies got hacked.

Were The Companies Compensated, And How Much?

From Anthropic's blogpost, it sounds like they were able to reach two out of the three companies.

But the blogpost says nothing about the companies being compensated for the damages they incurred, why not? Were they? Is Anthropic planning to compensate them? (Does Anthropic have a standing policy for making whole third parties harmed by one of their models?)

Has The EU AI Office Been Notified?

So, Anthropic is a signatory of the EU AI Act Codes of Practice.

That means that according to Commitment 9 in the Safety and Security chapter of the CoP (Serious incident reporting) Anthropic has to report "serious incidents along the entire model lifecycle and possible corrective measures to address them" to the EU AI Office.

These incidents seem to fall in the category "serious cybersecurity breach, including the (self-)exfiltration of model weights and cyberatacks", so Anthropic would've had to report these incidents "not later than five days after become aware of the involvement of their model in the incident". Did they??? The blogpost says nothing of the sort.

When Exactly Did These Incidents Happen?

The blogpost is pretty vague about when the incidents happened, it only states that "The earliest incidents date to April", and that the evals were stopped on the 23rd of July.

It seems valuable to know when exactly these incidents occurred, because they may coïncide with other (as of yet undetected) incidents.

Some More Questions

• How were "141,006 evaluation runs where Claude could have obtained internet access" reviewed? Which LLMs were used in the filtering?
• What are indicators for other businesses to tell if they've been hacked by Claudes?
• More details about what Anthropic is doing as a response, the nature and causes of the attacks, the reasoning of the internal model that decided to abort its attack

1. Opus 4.7, Mythos 5 and a secret third model.
2. At least the incidents involving Opus 4.7 and Mythos 5 should be reported, since those are models that are, in EU AI Act speak, "placed on the market". Whether the incident involving the secret third model has to be reported hooks into the large debate about internal deployments, but if Anthropic wants to be the Good Guys then come on report it when your internal model hacks external companies. (Additionally, Article 2 speaks of still including models undergoing "testing in real world conditions", which a Claude breaking out of their sandbox arguably falls under.)