Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B

We're launching Precision Numerics by releasing Boole-1.7B, a 1-bit version of Qwen3-1.7B. 247 MB packed weights: 13.9× smaller than BF16. 85.9% of the BF16 model’s average score across our 10-task evaluation - outperforms 1-bit Bonsai-1.7B and nearly matches 1.58-bit Bonsai-1.7B. Try it locally in your browser (it's for low-latency tasks using English and non-thinking mode), or use it with vLLM or llama.cpp. We'll ship more capable models for the open-source community. Let us know what you what models/capabilities you want to see next. Blog: precisionnumerics.ai/blog/boole-1p7b Weights: huggingface.co/precision-numerics/Boole-1.7B Demo code (for vLLM, llama.cpp): github.com/PrecisionNumerics/boole-demo Local chat in browser: precisionnumerics.ai/chat/

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论