back
1 comments
how many times do you have to be metaphorically hit in the head with a brick before you realize inference margins at api pricing were 80%+
I was metaphorically hit in the head with the brick of already provisioned computing with a lot less demand than anticipated by multiple MoUs.
So, does that mean they're selling tokens at cost? Or that they realized they were doing 180% more work than necessary and they're passing the savings on because "your margin is my opportunity" and this is a dog-eat-dog fight, but 80% margins are nice, no one needs multiple hundreds?
I genuinely don’t get why you will not accept the simplest explanation? They found efficiencies? Why all these contrived explanations??
Uh… are you okay? That’s a completely disproportionate, aggressive tone. How is that warranted
Disproportionate yes but you seem still confused on how it’s economically possible when

1. The basic mechanism is literally described in the post: they found efficiencies and passed it down

2. This has been the trend for all the time LLMs have existed

Why confusion then? What’s surprising you?