Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s with MTP

Piszczek.pl，I don't build companies. I build systems that remove friction from entire industries. CTO of Archdesk. Founder of Lextron.ai, Inclify, Rejsomat.pl, Robotero (acquired). Author of Joule Wars.关注
Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s with MTP 图片 1
添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论