Coding Models Are Code
Qwen 3.6 27B (currently a popular model to run locally) ships on Hugging Face as 15 safetensors files totaling 56GB of BF16 floating point numbers, or as smaller quantized GGUF conversions. You download the weights, load them into an inference engine like Ollama or LM Studio, and point your coding agent at them.
Safetensors (the format these weights ship in) exists so that loading a model can’t execute code the way loading a Python pickle could. This makes it safe to deserialize the weights.
评论
?
参与讨论