Why Don't We Put Handguns in the Convenience Aisle?

A quick thought on this whole "control of AI models" debate.

Handguns and Fentanyl are available all over the world, but we still don't put them in the convenience aisle at grocery stores.

The reason we don't is because we want friction between people having negative, impulsive thoughts and them actually taking those actions.

If ChatGPT, Claude, and the most popular open source models answer every question about harming oneself, or hurting someone else, or hacking into X or Y, or making a virus that only kills yapping chihuahuas, we do not want that AI to help with that.

We want it to say something like, "No, sorry, I can't help with that. But hey let's talk about it, what's going on?"

That's a control. Same for planning terror activity. Or to kill your spouse.

Yes, models will be a…