First attempts at a CPU setup - MS-02 Intel 285hx, trying Qwen3, Qwen3.6 and Gemma4
I got a new mini-pc for a homelab server recently and thought I'd tinker around with some LLM options on there. As it doesn't have a dedicated GPU it was a bit different to what I do on my main PC. Wasn't really sure where to start, but I had a little bit of guidance on what to try first, so I gave it a go. Ended up with Llama.cpp for the most part. I tried Llama-Swap, and the quick swapping is very helpful, but it seems not to work with SYCL unfortunately so it made testing annoying. System is an MS-02, wi
评论
?
参与讨论