Someone apparently managed to kind of replicate what V4.1 flash does on KV for fast prefill on Qwen
I wonder someone will figure out a way to do this with 27B? Throw Qwen3 on this page for demo kishida.github.io/webdemos/llkvapprox
评论
?
参与讨论
I wonder someone will figure out a way to do this with 27B? Throw Qwen3 on this page for demo kishida.github.io/webdemos/llkvapprox