I guess there is a new infrence engine in town

Tried it, works as it says. There is also strix halo support as well that I think beats llama.cpp for this model. Pretty cool. github.com/Atlas-Inf/atlas

参与讨论