Why LLMs Run on GPUs, Not CPUs

It’s not because GPUs are magic AI chips I used to think GPUs were used for LLMs because they were special hardware built for AI. That is close, but not really the useful answer. The better answer is: LLMs became GPU-shaped. A GPU does not understand language. It does not reason. It does not know what your prompt means. It is just very good at doing the same numeric work across a massive amount of data. And that is mostly what modern LLM inference is. From text to numbers When you send a prompt to an LLM, t