Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀

Qwen3.8-Flash-Next (~125B-A6B + 51B n-gram) memory estimate: Ideal 4-bit quant ≈ 82 GB (58 GB main weights + 24 GB n-gram tables) Real-world quants likely land in the 80–90 GB range. The big n-gram table is sparsely accessed → excellent candidate for system RAM offload. This architecture could be surprisingly local-friendly once the weights drop.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论