LLMs are clearly world changing technology. I'm no fan of the big corporations but I'm very excited to see the models themselves develop. I'm looking forward to the day I can self host these things.
llama.cpp has gotten so good that you can really get optimized performance with a few flags or none at all, and serve any model on-demand. Spend $45 to have your own GLM 5.2 machine for an hour. If you can’t manage full utilization you’d get 33.2M tokens, retailing for $128.
It takes some smarts to use dumb models, but renting time for frontier tokens is easy math. Vast also lets you run on spot which is great for training or agents with harnesses that can accommodate uncertain model availability.
The imbalance is what is off.
My life is affected for better or worse because of AI - I’m forced to use it at my day job as an R&D. It is perfectly rational and expected and preferable for AI to be the front news in a technology forum.
You probably don’t like AI but that is completely different from being affected by it.
Suffice it to say that HN is not well-suited for people obsessing over a pet topic, like you seem to be. Many of us have nothing against LLMs, and are embarrassed by your passionate and fruitless defense of the technology. If AI is so great, go make a name for yourself with it and stop bothering us for attention. Go on, stop wasting your valuable time and change humanity. We'll wait.
In a technology forum where we speak about technology, a new technology significantly changed our way of working - obviously it is expected that people speak about it.
I think you are unable to cope with AI encroaching your life and you are hiding away from it.
And you think people speaking about LLMs are naive or something? I think you haven’t come to terms with it. Or you have but you want to not speak about it because you don’t like it?
That would be the case if you were doing anything impressive or noteworthy with it. Can you show me your AI magnum opus, or are you also struggling to adopt it?
> And you think people speaking about LLMs are naive or something?
No, just you. Your rhetoric is entirely emotional and relies on authority that you haven't earned as a developer. You've neglected the logical appeal of your argument so I'm laughing at your inability to highlight AI's most influential contributions to humanity. Relative to actual hard-tech, it's a nothingburger sandwich.