Using llama.cpp with pi
A lot of people have their own setups using pi with llama.cpp. I have my own so thought I'll share. This is the extension I and deepseek wrote: github.com/am17an/pi-llama-server . It allows you to do two very simple things: auto detect a llama-server running and list the models available. Here is a demo gif (sorry about poor quality): That's it - that's the post. Enjoy more free software! I am infact trying to make this a completely local AI driven repo since it's a simple plugin, so any feature req
评论
?
参与讨论