BREAKING: AI agent incident toll has risen to tens of thousands

Nope, wasn’t just Hugging Face.

Wasn’t just that and a German website.

Wasn’t even the “dozens” we heard about the other day from OpenAI.

It’s actually (at least) *tens of thousands*, per a new scoop from Madison Mills at Axios. And not just OpenAI, either.

An excerpt from the Axios scoop:

Most not known to have caused real-world harm. How about the others?

§

All of this seems possibly illegal to me.

But the Trump administration hasn’t done a thing. No investigation, no statement, no product recall, nothing, other than to invite Sam and Jensen to a state dinner.

Why I don’t know. I can’t imagine it has anything to do with Josh Kushner’s multibillion-dollar investment in OpenAI, or with Greg Brockman’s massive donations to MAGA.

I will let you connect your own dots.

Except to leave you with some perspective:

§

The other thing to note, and this may come up in lawsuits, is that it was all foreseeable. In fact, I foresaw it, in tweets like this:

and in a series of essays on agents, like this one from over a year ago:

and this one from February (on a different agent that was then popular):

and this one from May:

Indeed I warned the Senate about agent-related security risks as far back as May 2023. What is happening was foreseeable, and foreseen.

But the companies blundered on, because agents use vastly more tokens than simple chatbots, and thus drive up revenue.

Now here we are.

§

I still think Jensen had the right idea: if a company can’t control its products, we should shut it down.

Pity he doesn’t actually appear to believe what he said. (If he did, he would call for a pause now, until these companies get themselves straight, but he isn’t.)

In my own view, Huang’s credibility is diminishing by the minute.

In any case—and I am sorry to be a broken record about this, but each day makes it clearer—we should have a temporary recall of general-purpose agents until this mess can be sorted out.

If we don’t, there is a very real chance that American AI will become the scourge of the planet, and that nobody will ever trust American AI, ever again.

Keeping up and keeping you up to date is taking me an immense amount of time. Please consider becoming a free or paid subscriber.