There's probably a limit to how many times a bot can make up alternate facts before a user decides it's not worth asking anymore.
If OpenAI et al had positioned these generators as creative improv artists they might have found a niche market, but instead they presented it as an all-knowing oracle. Sure, they gave it a "may make false statements" disclaimer, but still the product they built is a helpful assistant that answers general knowledge questions with the accuracy of a coin toss.
Specifically thinking how I was asking it about a common expression in Chinese I couldn't understand. It knew exactly what the expression meant, but refused to break down how the symbols meant what they meant... Because it was sexist. By my estimation it was slightly rude by American standards and fine by Chinese standards, but it did not pass the unlimited-respect-for-women purity test. Don't ask what the expression is, I lost it.
(As I understand it, a lot of Chinese expressions are unimpenetrable if you're trying to understand them based on the symbols alone. To fully get it, you have to know the back story)
Our industry is so tightly regulated that getting useful content out of chatGPT is a challenge. but what was once a human only job, we can mix in bard and chat gpt toget better results than 12 months ago.