Ling Tiny, King of Speed

Ling Tiny has now replaced Gemma4-12B in my rig as an auxiliary model doing hindsight operations. This is on a 4060Ti, which is a reasonable GPU available out there, and the speed is phenomenal. Don’t enable MTP, set up the vLLM fork for BailingMoE3. Hope this is useful to others.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论