wsxiaoys

Fun fact: We've implemented binary embedding search [1] without the need for a specialized vector database. Instead, dimensional tokens like 'embedding_0_0', 'embedding_1_0' a…

TabbyML | https://tabbyml.com | Software Engineer (Rust) / Product Engineer – Full-Time | Remote Tabby strives to become the AI Intelligence Stack for the entire development lifecycle…

Checkout tabby: https://github.com/TabbyML/tabby Blog post on repository context: https://tabby.tabbyml.com/blog/2023/10/16/repository-context…

Can the diagram being part of the code it self (e.g special comment string on top of certain piece, or in a special metalfiel) It'll be really nice if the code diagram itself could be version tra…

Nice implementation! It should serve as a great reference for a minimal Tabby's backend API. Thank you for sharing it! Yeah - ultimately, it won't be as performant or feature-rich compared t…

Wow, this is a great topic. I don't really have specific suggestions, but I'd like to contribute some thoughts on the matter. Monetizing anything isn't inherently problematic; the chall…

TabbyML | Software Engineer (Rust) | Open Source | REMOTE Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot. Project: https://github.com/Tabby…

Previously, Tabby ran exclusively on CUDA devices, posing a significant barrier for developers looking to effectively utilize LLMs in their day-to-day coding. The Tabby team made a significant contrib…

For the 1B version of the model, it operates at approximately 100 tokens per second when decoding with Metal on an Apple M2 Max. llama_print_timings: load time = 114.00 ms llama_print_timings…

Paper: https://arxiv.org/abs/2308.07124 Highlights: This paper demonstrates the instruct fine-tuning code for Language Model Models (LLMs) using public Github commit data. The pr…

Check out https://github.com/TabbyML/tabby , which is fully self-hostable and comes with niche features. On M1/M2, it offers a convenient single binary deployment, thanks to …

A less hyped inference engine with INT8/FP16 inference supports on both CPU / GPU (cuda). Model supports list: GPT-2, GPT-J, GPT-NeoX, OPT, BLOOM, LLAMA, T5, WHISPER ( Found this library dur…

TabbyML | Full Stack Engineer / Machine Learning Engineer | REMOTE Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot. Project: https://github.…

Nice work! Added to https://github.com/wsxiaoys/awesome-ai-coding

Thank you, I was inspired by the brilliant ideas presented in the employer handbooks of Posthog and GitLab, as acknowledged in the career page.

There it is: https://marketplace.visualstudio.com/items?itemName=TabbyML.... …

Thanks, I'm just so into the puns: Tab-by-ML / TabbyML / Tabby

Linked my replies to others' questions: [1], [2] [1] https://news.ycombinator.com/item?id=35471882 [2] https://news.ycombinator.com/item?id=35471390 I hope these…

Tabby's philosophy is to achieve a completion rate comparable to Codex/Copilot by using a model size of less than 1B, with support for BF16/FP16 that reduces VRAM requirements to 2G or …

Tabby is tested against various open-source models based on GPT-J/GPT-NeoX, including https://huggingface.co/CarperAI/FIM-NeoX-1.3B and https://huggingface.co…

Tabby collected the source code from the related repository and built them into a dataset. I already have some proof-of-concept pipelines built [1] and [2], but I still need some time to polish the da…