The case for disaggregated LLM serving

Three checkable conditions under which disaggregated prefill is never worse
than aggregated serving, and the reasons it's usually better. Plus an
inventory-theory model of traffic drift: cold starts, safety stock, and a
map of the shocks a deployment can ride out.