AbliteratedOutTheBox Strata Announcement
I’ve been working on an inference-time abliteration engine as a fork of llama.cpp, and I’ve now ported the hook to Strata. It acts as an easy way to use abliterated models without huge amounts of vram or finetuning. For the Strata Branch github.com/heterodoxin/AbliteratedOutTheBox/tree/strata For the llama.cpp branch github.com/heterodoxin/AbliteratedOutTheBox A star or upvote would help this project a lot. The Strata port is experimental, full-model behavior and response quality still need validation. If anyone running Strata wants to try it, I’d appreciate feedback
参与讨论