Muse Spark on a single Mac Studio

Update from yesterday: 18 t/s decode was hit. Slight regression now as cherry picking from other ds4 work trees proceeds. Will push some code once the prefill droop is handled and the 18 t/s restored. Weights are gated on hf, so mulling upload vs. recipe. Ps. This is text only. Output is coherent and toolcalls solid.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论