Quantization hurts knowledge nonlinearly – Qwen3.6 27B case study

Quantization is a lossy compression, and factual knowledge is incompressible. We test Qwen3.6 27B GGUF quantizations from Hugging Face (by Unsloth and Bartowski) and llama.cpp on the Incompressible Knowledge Probes (IKP) benchmark.
评论
?
参与讨论