[Open PR] llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

PR by u/Stainless-Bacon 👍 It would be handy & awesome to have options --n-cpu-ffn / --cpu-ffn for Dense models like how we have --n-cpu-moe / --cpu-moe for MOE models . Also check his threads: On PR : llama.cpp CPU offload optimizations On Running Qwen3.8-27B with above optimization : Guide for running dense models on ≤16 GB VRAM ( Qwen 3.8 27B on 16 GB -> Q4_K_M, 130k ctx, ~20 t/s) ( Awesome to see the big comment by u/Pablo_the_brave there, filled with so much stuff. Quoting a line from there Do not touch block 64 (MTP) if you are using speculative decoding — its FFN should remain on the GPU. ) We should've got this option long time back actually. This PR instantly reminded me of last year thread . (I literally used his -ot command for sometime with Qwen3-14B. I'm just happy that I was able to recall a last year thread.) Anyway .... Better late than never. Waiting for this merge.