Quantization hurts knowledge nonlinearly – Qwen3.6 27B case study

Quantization hurts knowledge nonlinearly – Qwen3.6 27B case study 图片 1

Quantization is a lossy compression, and factual knowledge is incompressible. We test Qwen3.6 27B GGUF quantizations from Hugging Face (by Unsloth and Bartowski) and llama.cpp on the Incompressible Knowledge Probes (IKP) benchmark.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论