Qualcomm launches GenieX to run LLMs on their Windows Laptops

Qualcomm was behind every major chipmaker so they are playing catchup when it comes to SDKs. aihub.qualcomm.com/geniex I was able to get 20 tok/s running Gemma 4 26B A4B 0.5s for first token running on the GPU or NPU 10 tok/s on the GPU for Qwen 3.6 27B MTP To use llama.cpp, just get any Q4_0 GGUF model and it will run on the CPU,GPU,NPU submitted by /u/DerpSenpai [link] [comments]