I Think You Might Be Fooling Yourself with AI

If you are enthusiastic about AI (LLMs), you may be fooling yourself. Do not consider this an insult, but a kind-hearted warning.

Remember what Richard Feynman said:

The first principle is that you must not fool yourself and you are the easiest person to fool.source ( backup )

He made this statement as part of the Caltech's 1974 commencement address. In this speech he strongly advocated for proper scientific integrity.

I feel it can be difficult to maintain proper 'scientific integrity' on a personal level as AI is a fast-moving target. The tools feel unreasonably capable, using an LLM makes you feel more productive when writing code for instance.

Yet as of today, there is no independent scientific evidence 1 (that I'm aware of) that people or organizations are indeed more producti…