> It's not completely wrong all the time.
But it makes up plausible answers and even fake references. Which makes it worse than something which is always dead wrong.
back
3 comments
And it seems, to my totally unqualified eye, that the creators did this intentionally. Because why not have ChatGPT respond with "my data does not enable to respond properly" everytime it makes stuff up? Because this whole thing would look a lot less impressive?
Because it has no idea if it's spouting bullshit at the moment or not.
And that doesn't seem to be addressable as long as the model is just stringing together the next most likely words as it learned them from some huge dataset. The answer "i don't know that" will always be rare, because nobody sits down and writes a blog post about how he could not find the solution to a problem.
Wouldn't it be great if there were a lot more ofbthose blog posts around?
Agreed, it's a problem right now. But conceptually, there are multiple ways (persistent memory in embedding dbs to reference, coupling it with search engines and data sources) it can get better.
A reference in a scientific journal to a piece of fraudulent research is far worse than a fake reference to a non-existent journal. Let's keep things in perspective?