LLM Quantization Part 2.5: Do Floats Dream of Real Numbers?

When a model stores 0.1, it isn't storing 0.1. This article breaks down what a number actually is to a computer, how floating point splits its bits between range and precision, and why models barely use either, which is exactly what makes them shrinkable.