Building a Native 1-Bit LLM Engine in Pure Rust: Achieving 150+ TPS and 350MB Memory Footprint on Edge CPUs. [P]

There's been a ton of academic hype recently around 1-bit quantization, BitNet (1.58b), and pushing LLMs to the absolute edge. I've spent the last few months quietly trying to take this from a theoretical whitepaper into an actual, production-ready reality. I decided to completely bypass PyTorch, llama.cpp, BLAS, and CUDA. Instead, I wrote a custom, zero-dependency inference engine entirely from scratch in pure Rust that runs native 1-bit and ternary packed models directly on standard edge CPUs. To prove