back
user profile
wsxiaoys
1,389karma·185submissions·March 30, 2011
about
meet.hn/city/us-Sunnyvale
Socials: - cal.com/mengzhang - linkedin.com/in/mzh0 - github.com/wsxiaoys
---
recent activity (185 total)
comment
> Would be interesting to know how much a jj-specific SKILL.md would race the score. That is definitely something we're interested in; we will try running this evaluation with skills soon. >…
comment
Hi HN, I wrote a 4-part series on how we built the AI edit model behind Pochi’s coding agent. It covers everything from real-time context management and request lifecycles to dynamically rendering cod…
comment
OP here - I've talked in detail about how we rendered NES suggestions using only VS Code public APIs. Most tools fork the editor or build a custom IDE so they can skip the hard interaction proble…
comment
OP here - happy to answer any questions. This was one of the more unexpectedly tricky layers of building real-time LLM suggestions, and I’d love to hear how others have approached timing, cancellation…
comment
OP here - this is Part 2 of a series documenting how we built NES (Next Edit Suggestions), our real-time edit model inside the Pochi editor extension. The real challenge (and what ultimately determine…
comment
I’ve been experimenting with next-edit prediction for a while and wrote up how we trained the edit model that powers our Tab completion feature. This post is part of a broader series where we share ho…
comment
I've spent the last few months working on a custom RL model for coding tasks. The biggest headache has been the lack of good tooling for tuning the autorater's prompt. (That's the judge…
comment
Appreciated! Fixed
comment
Yes - however, the FIM model requires careful configuration to properly set the prompt template.
comment
> So using 2 NVLinked GPU's with inference is not supported? To make better use of multiple GPUs, we suggest employing a dedicated backend for serving the model. Please refer to https:/&…
comment
Yes - AMD GPU is supported through vulkan backend: https://github.com/TabbyML/tabby/releases/tag/v0.23.0 https://tabby.tabbyml.com/blog/2024&#…
comment
Tabby comes with builtin RAG support so you can add this api framework to it. Example: https://demo.tabbyml.com/search/how-to-configure-sso-in-tabb... Settings page: https:/…
comment
Not yet, consider subscribe https://github.com/TabbyML/tabby/issues/322 for future updates!…
comment
Check https://www.reddit.com/r/LocalLLaMA/s/lznmkWJhAZ to see a local setup with 3090.…
comment
Tabby is engineered for team usage, intended to be deployed on a shared server. However, with robust local computing resources, you can also run Tabby on your individual machine. Check https:/&#…
comment
Never imagined our project would make it to the HN front page on Sunday! Tabby has undergone significant development since its launch two years ago [0]. It is now a comprehensive AI developer platform…