Qwen 3.8 27B Overthinking, It has to be done, it has to be overthinking to punch Opus 4.6
Yes, it sucks to waste time waiting on 16K+ reasoning tokens alone. But here's the thing, this is only a 27B model trying to perform on par with 1T+ parameter models. Something has to be sacrificed, and that sacrifice is the amount of reasoning or trajectory tokens. This isn't new to LLMs whatsoever. Andrej Karpathy himself has said that LLMs need tokens to think. He mentioned this somewhere in his "Let's build GPT" / GPT video series, although I don't remember exactly when, if i am not mistaken it is when he showed Llama base model SWE-Rebench also pointed this out: swe-rebench.com "Qwen Next, and Step 3.5 as well, are extreme examples of requiring a huge number of tokens". FYI, Qwen Next was also the first Qwen model with GDA. SWE-Rebench notes that it "averages about 8.12M tokens per problem." Another side tangent is VibeThinker 3B. That model is purpose-built for solving logic and math problems, not agentic workloads or tool calling. I've personally tested it, and it's basically a grad level math model crammed into 3B parameters. But again, it absolutely loves munching tokens. And again, it's a 3 fucking billion parameter model . I can fucking run this thing on my phone, for God's sake. As for expectations, before the LLM storm, finding and fixing a bug could easily take 3 hours, sometimes even days or weeks. Now, with a n-shot prompt, it can often be done in under an hour. I assume most of us came from GPT / Claude models first before stumbling into local models like these, so we've been spoiled by fast token generation. Idk about you guys, but of my use cases are actually daily search tasks. I'm probably going to use Gemma 4 26B A4B, or hell, even good old GPT-OSS 20B (This post's grammar itself has been corrected by my GPT OSS), because when I look at my token usage in the gateway, most of it is RAG and code search rather than actual code generation. Wasting tokens is wasting time, sure, but you can do other things while Qwen 27B is finding the error. That's free time that LLMs gave back to you. Yes, it might take an hour if you're running it on a 4060 Ti, but again, it's like a robot vacuum. It takes time, but not your time. That's also why I'm perfectly fine running DSv4 Flash at 6 tok/s. At the end of the day, Qwen is technically and philosophically almost the Anti OpenAI. It's Apache-licensed, it gobbles tokens like there's no tomorrow, ( GPT models are among the SOTA models that tend to expose relatively few reasoning tokens at the API surface atleast) , it's yours, it can get the llmfan46 treatment, and of course, a 16 GB VRAM card plus system RAM can realistically run it. And also you can hard limit reasoning to 8192 in llamacpp and vllm if you want.