nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB · Hugging Face

NVIDIA-Nemotron-3.5-Bolt-E4B-4GB is a small language model (SLM) further post-trained from Gemma-4-E4B-it by NVIDIA. Nemotron-3.5-Bolt-E4B carries forward Gemma’s strong conversational capabilities and further improves multi-turn tool use, instruction following, and input grounding for fast local voice/device assistants, interactive personas, and embedded/edge interfaces. Designed for low-memory, low-TTFT operation, the model allows agents to respond quickly while preserving headroom for applications or adjacent model pipelines. For speculative decoding, use the companion DFlash drafter . For the full-precision (BF16) version, see NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 . This model is ready for commercial or non‑commercial use. huggingface.co/ggml-org/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF huggingface.co/unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF research.nvidia.com/labs/nemotron/files...-3.5-Bolt-E4B-4GB-Technical-Report.pdf

参与讨论