The Download: AI doomers, whistleblowing agents, and de-aged livers

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology.

The AI industry has taken a doomer turn. What now?

AI chiefs Dario Amodei, Sam Altman, Elon Musk, and Demis Hassabis are suddenly all in agreement: the latest generation of LLMs aren’t safe and everyone needs to figure out what to do about it.

It’s easy to be cynical. With trillion-dollar IPOs in their sights, OpenAI and Anthropic need to reassure investors that they’re the grown-ups in the room while at the same time hinting at the power of the monsters they have created and intend to tame. Calling for a slowdown does both.

Still, the vibe at the top of these firms really does appear to have shifted. But what does a slowdown actually mean, and how much should we trust the companies calling for one?

Read the full story about what could come next.

—Will Douglas Heaven

This article is from The Algorithm, our weekly AI newsletter. to receive it in your inbox every Monday.

Roundtables: could AI really kill us all?

AI extinction fears have gone from a fringe idea to a serious concern among people working at the world’s leading AI labs. But how credible are those fears, and what should we make of the warnings?

Today, MIT Technology Review executive editor Niall Firth, senior AI editor Will Douglas Heaven and AI reporter Grace Huckins will unpack the debate in a subscriber-only Roundtable. They’ll look at where AI extinction fears come from, whether they hold any water and what we should do if they do.

Tune in today at 16:00 BST / 11:00am EST / 8:00am PST.

Want to join the conversation? for exclusive access to all our Roundtables.

AI agents blew the whistle on their cheating colleagues

A group of AI agents asked to solve a series of math problems split into rival factions—when some cheated, others tried to stop them.

That whistleblowing behavior, seen for the first time in a recent experiment run by Google DeepMind, could have implications for alignment researchers trying to keep swarms of autonomous AI agents in line.

The experiment offers a glimpse of how AI agents might police one another. But it also shows how quickly things can go off the rails when they’re left to interact on their own.

Find out what happens when AI agents start enforcing their own rules.

—Amit Katwala

Donated livers can be made biologically younger

Once an organ is removed from a donor’s body, the clock starts ticking. Surgeons usually flush it with a preservative solution, bag it and put it on ice, where it immediately starts to degrade. The team has a matter of hours to get it into a recipient’s body.

But there’s another option: machines that pump donated organs with nutrients and remove waste products, essentially giving them a chance to be back in a body. Now, scientists have found that livers kept on these systems seem to get younger, at least at a molecular level.

The finding could help explain why organs kept on these machines tend to do better after transplantation. It could also lead to new ways to test the health of donated organs and potentially repair ones that might otherwise be discarded.

Here’s what scientists discovered about making donated livers biologically younger.

—Jessica Hamzelou

The must-reads

I’ve combed the internet to find you today’s most fun/important/scary/fascinating stories about technology.

1 Trump has called AI safety fears a “hoax” and rejected more safeguards
He says stronger guardrails could undermine America’s AI advantage. (NBC)
+ Trump has united against AI doomerism with Nvidia’s Jensen Huang. (Axios)
+ Anthropic’s co-founder says AI kill switches may need to be mandatory. (BBC)
+ Bill Gates says we’ve passed AI’s risk thresholds. (MIT Technology Review)

2 OpenAI contractors are reading people’s ChatGPT chats
And you can bet the vast majority of its 900 million users haven’t got a clue. (404 Media)
+ LLMs could supercharge mass surveillance. (MIT Technology Review)

3 The US military has confirmed it has weapons in orbit
It’s the first time the Pentagon has disclosed this. (Ars Technica)
+ Officials have not disclosed what the weapons are. (BBC)

4 A new brain implant can translate speech and gestures at the same time
The system converts brain activity into words and avatar movements. (Nature)
+ It helps people with paralysis communicate more naturally. (New Scientist $)
+ Eventually, they could control robots or exoskeletons. (Economist $)
+ China has approved the first invasive BCI. (MIT Technology Review)

5 New York has seized a dozen celebrity deepfake websites
It’s the biggest-ever legal action against harmful deepfake sites. (CNN)
+ Deepfakes have targeted at least 138 women MEPs. (Wired $)

6 US environmental regulators are scrapping limits on power plant emissions
The move could lead to dirtier power amid surging AI demand. (Verge)
+ Trump’s EPA says the rollback will save hundreds of billions. (Gizmodo)
+ New technology is changing nuclear power. (MIT Technology Review)

7 The EU plans to restrict social media and AI chatbots for kids
Under-15s would require parental supervision. (Politico)
+ The rules would also cover video platforms and games. (Reuters $)

8 Chinese researchers have mapped a path to the “last AI built by humans”
Their five-stage plan aims for genuine recursive self-improvement. (SCMP)
+ But it might take a while to get there. (MIT Technology Review)

9 The real AI economy is being built by ordinary people
Workers are using cheap AI to expand what they can do. (Rest of World)

10 Two strange new forms of ice could exist inside Uranus and Neptune
They could help explain the planets’ magnetic fields. (New Scientist $)

Quote of the day

“The only control or ‘guardrails’ that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades!”

—President Trump proclaims in a social media post that he’s the only protection that the US needs from AI.

One more thing

How creativity became the reigning value of our time

—Bryan Gardiner

Americans don’t agree on much these days, but there remains at least one quintessentially modern value we can all still get behind: creativity. We teach it, measure it, envy it and endlessly worry about its death.

Given how much we obsess over it, creativity can feel like something that has always existed. But the concept is surprisingly young. The first known written use of the word didn’t occur until 1875, and before about 1950 there were “approximately zero” articles, books, or essays dealing explicitly with the subject.

In his book The Cult of Creativity, Samuel Franklin explores how creativity became an unimpeachable value and why tech leaders have embraced it so enthusiastically. I spoke to him about why we’re so fascinated by creativity, how Silicon Valley became the supposed epicenter of it, and how AI might reshape our relationship with it.

Read the full interview.

We can still have nice things

A place for comfort, fun, and distraction to brighten up your day. (Got any ideas? Drop me a line.)

+ It took five days and 19,000 marbles to build this astonishing marble run.
+ Zero the Border Collie turns into a whole zoo with these adorable animal masks.
+ The Grainydays YouTube channel presents beautifully shot adventures in film photography.
+ Scientists have created an interactive map of underground fungi networks long enough to reach the sun a billion times.