On top of that isn't it strange that if the LLM makes a mistake you're still charged for those tokens?
They're selling "intelligence", automation, etc but if the service doesn't work as expected the user has to pay for that.
back
2 comments
You're paying for a service with known flaws. They do not guarantee correct answers.
Also, LLMs don't "make mistakes". They don't think or act. Every single thing they output is a hallucination. It just happens that the vast majority of things align with reality.
If I use electricity to do something stupid, I still have to pay for the electricity. Intelligence is just another utility.
Spend 5 minutes on the marketing pages of any AI company and it's obvious they're not selling electricity, fuel, or even raw compute.