back
user profile
HenryNdubuaku
947karma·141submissions·October 24, 2021
recent activity (141 total)
comment
That was the goal!
comment
Haha, we were trying to not be hand-wavy too much :)
comment
Ok, will do that now!
comment
Thanks, let us know how it goes!
comment
thanks, yeah, the problem is just handling scale, we don't have the infra ready to go, but anyone can do that. Its easy for people to run on their laptops straight up. Will try the VPS route.
comment
So Needle is trained for INT4, what you see in the playground is INT4, only 14MB, same challenge though.
comment
Fixed now, apologies!
comment
Cactus (YC S25) is a low-latency engine for mobile devices & wearables. Cactus runs locally on edge devices with hybrid routing of complex tasks to cloud models like Gemini & Claude. Come buil…
3 pts
comment
What do you think?!
comment
Will look into this!
comment
thanks! will do
comment
I lowkey am enjoying this conversation lol.
comment
These have now been pushed!
comment
We call it Maths & Econs in England actually.
comment
ok, on it! I will reply in this thread so you can start contributing.
comment
Code walkthroughs and exercises are included, in Jax
comment
Valid question. Our perspective is that there can be multiple players, there are 7B devices to power, everyone will get a slice.
comment
You don’t have to bundle the weights as an asset, you can do over-the-air updates, new weights are simply downloaded.
comment
Apologies for this, but you have nothing to worry about, no one is suing you. We are experimenting with the license and monetisation for corporations not indie developers. Please keep using Cactus the…
comment
Yes, you can fine-tune a model for any task, what do you have in mind?
comment
You can add a web_search tool, checkout what these guys did with Cactus: https://anythingllm.com/mobile
comment
Ok, looking forward to it!
comment
It’s custom for now as we are calibrating to see what works for everyone, wanna get in touch?
comment
We host on HuggingFace, were you able to get it to work eventually?
comment
Thanks for pointing this out, another factor for us to figure out. We waive the license for such cases, wanna get in touch? I don’t think your consumers have to worry about the license.
comment
We are focused on phones and we did add some benchmarks and will add more. However, anyone can see performance for themselves with the repo directly.