Check out https://github.com/TabbyML/tabby, which is fully self-hostable and comes with niche features.
On M1/M2, it offers a convenient single binary deployment, thanks to Rust. You can find the latest release at https://github.com/TabbyML/tabby/releases/tag/latest
(Disclaimer: I am the author)