Fastest speculative decoding for qwen

Hey guys, we’ve built fastest speculative decoding for Qwen at least. To run in sglang you can use our fork Hf link Would appreciate your feedback and tests. Please let us know what we can do to make your experience better. Support in our engine uzu will come a bit later. submitted by /u/darkolorin [link] [comments]