back
user profile
apitman
13,487karma·3,567submissions·December 11, 2014
about
Software architect on the iobio team at the University of Utah Eccles Institute of Human Genetics. I'm passionate about the application of computer science to solving health problems. Hans Rosling is my hero.
Personal site:
apitman.com
Projects:
IndieBits.io - A community for data ownership, self-hosting, and decentralization.
LastLogin.net - A free, privacy-focused login provider
TakingNames.io - Domain names for self-hosters
boringproxy.io - Simple, e2ee tunneling proxy
droplock.apitman.com - Simple secure secret sharing
recent activity (3,567 total)
comment
I accidentally read this as "there's lawyers below root" and I'm not sure I'm wrong.
comment
As much as I wish it were otherwise, Vulkan is nowhere near a good alternative for CUDA currently. Maybe eventually, but not without additions to nothing the core API and especially available librarie…
comment
> It's easy to get a local LLM running Easy for what percentage of people?
comment
Jan also supports connecting to remote APIs (like OpenRouter), which I don't think LM Studio does
comment
I was referring to Jan.
comment
I really like Jan, especially the organization's principles: https://jan.ai/ Main deal breaker for me when I tried it was I couldn't talk to multiple models at once, even if…
comment
Not exactly. OWUI is a server with a web app frontend. Jan is a desktop app you install. But it does have the ability to run a server for other apps like OWUI to talk to.
comment
Their new app is closed source right?
comment
I was under the impression that context takes up a lot more VRAM than this.
comment
Did you test multi-user cases?
comment
So I still need SNI for IPv4 requests.
comment
But you're still using NAT and SNI for IPv4 hosts, so there's little incentive to add the complexity of IPv6.
comment
I'm not really familiar with IPv6. If I have a million IPv4 servers, it's pretty simple to set up a million subdomains and route incoming TLS requests using SNI. If I have a million IPv6 ser…
comment
If I have a bunch of machines on my network and want them all to be able to access the internet, I can use NAT and let them all share a single IP. No one on the internet needs to do anything. If I hav…
comment
Yep. And the reason they were successful is because you can solve the problem on your end without the other end needing to do anything. IPv6 requires both parties to do something. So now we're st…
comment
IPv4 is never going away barring massive adoption of p2p protocols to drive the switch. Sadly NAT and SNI solve most of the problems well enough for things to limp along indefinitely. The only orgs wi…
comment
You can open a file for performant access in all major browsers. It's the same API used for uploading files (<input type="file" />), but you can also just load them into memo…
comment
Does anyone know why all of these WebGPU LLM demos have you download the models to browser storage rather than letting you open a gguf already on your local drive? I have several models downloaded alr…
comment
Doesn't Msty alreayd run models? What is LM Studio needed for in this setup?
comment
Good to know, thanks. What do people generally use to connect to it for chat?
comment
Is the Open WebUI license still OSI-compatible? I saw some drama about this on reddit but I'm not sure about the current state. https://docs.openwebui.com/license/ …
comment
Is there a way to get LM Studio to talk to remote OpenAI API servers and cloud providers?
comment
Kudos for making an effort to keep it small. Some of these Electron AppImages are 1GB+ which is pretty wild. How do you handle markdown rendering?
comment
I've been on something of a quest to find a really good chat interface for LLMs. Most import feature for me is that I want to be able to chat with local models, remote models on my other machines…
comment
Most humans don't know what a script is
comment
Like I said, an order of magnitude harder than it should be. It should be install app, do an oauth flow to open a tunnel, done.
comment
Backed up from what? People only use the cloud for backups, at which point the e2ee is compromised.
comment
If I only use 1 device for 5 years, then lose it, how do I recover?