Someone apparently managed to kind of replicate what V4.1 flash does on KV for fast prefill on Qwen

I wonder someone will figure out a way to do this with 27B? Throw Qwen3 on this page for demo kishida.github.io/webdemos/llkvapprox

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论