People want software that just works, they'll pay for it, they don't want to use their computers to build their own software. That idea is just software and computer geeks (said affectionately) projecting their own desires on a larger community.
I don't think it's happening at this scale. I'll admit I have no real data to back that up, it's just a hunch really. But I find it hard to believe that those people whom previously weren't interested in building software are now suddenly interested to build stuff with an LLM. I'm sure _some_ people are doing this, and then they either hit roadblocks and quit or stick with it an learn actual software engineering.
Looking at my non-tech bubble of friends and family, I don't see anyone actually doing that. I think it's a vocal minority that is doing this. That's just anecdata of course.
Right now, the greenfield is in how you use these tools. Making a bespoke specialized tool for yourself, or automating onboarding or CICD setups with simple commands or building bridges between "gatekept" existing software and agents are ripe for growth.
I get that we should see this as a good thing, but I see it as entering the last act of a play. Thousands of people are doing these things and coming up with uses for the tools around the clock. Novel uses for the technology will all be exhausted in the next couple of years and there will be less room for innovation than there was before LLMs.
Since you brought up Star Trek, a good analogue for AI would be the holodeck. Given the appropriate prompts, it produces amazing scenery and even immersive fantasy narratives.
But occasionally, it goes haywire, the safeties no longer work, and the characters from your fictional adventure try to kill you.
Now, what you might end up doing is removing the need for them to even have a computer to begin with. Someone without a job doesn't need business productivity software that much.