back

by doitLP·3y ago·view on hn ↗
Great…now OpenAI will become Microsoft Cortana SkyNet ClosedAI.

Somehow I doubt this will lead to a safe rollout of more and more advanced AI in the future.

2 comments
There is no scenario in which rolling out AI will be safe. As soon as someone sees it can be done, they will do it, copy it, or acquire it. Acquisition by the unscrupulous is practically guaranteed because AI is practically guaranteed to be extremely profitable, and there are several unscrupulous entities with tens of billions of dollars.

The only force guiding us into the future is the economic force of the free market, and while that has worked very well in many domains, it is now showing that it can also guide us towards destruction. We already know technology is addictive, and this is the first step to taking it to the next level and taking us away from being human.

Just think about this for a moment. What are some of the most rewarding interactions you've had with people in the past year? Do you think very advanced AI (such as the next generation after ChatGPT) would have affected that?

>We already know technology is addictive, and this is the first step to taking it to the next level and taking us away from being human.

Just think about this for a moment. What are some of the most rewarding interactions you've had with people in the past year? Do you think very advanced AI (such as the next generation after ChatGPT) would have affected that?

This is pointless FUD. We may be on the verge of creating entirely new lifeforms, interactions with whom will be every bit as real as those between humans. In fact they may end up being significantly more meaningful if you can create a kind of companion AI that is the perfect friend fine tuned for each individual person.

Creating new life forms? Many people can barely raise their own children. Can you imagine if tech companies create advanced lifeforms? It's truly a disaster waiting to happen.

It's rather rude to call it pointless FUD. AI messing up our world is real and I have thought it through at great length.

Having the perfect friend is actually immensely scary. It will create a world where people interact mostly with their electronic AI friends and where people no longer rely on each other. It is very unlikely that there will be any fabric of society left at that point, and people will start to hate the existence of other people...

The best thing that could happen would be the dismantling of all these tech companies by physically destroying all their servers and backups, just as we have done with huge stockpiles of nuclear weapons.

> Creating new life forms? Many people can barely raise their own children. Can you imagine if tech companies create advanced lifeforms? It's truly a disaster waiting to happen.

I never said it would be a good thing per se.

>It's rather rude to call it pointless FUD. AI messing up our world is real and I have thought it through at great length.

The particular comment I was referring to was FUD about humans losing their humanity due to interacting with AI, which to me is indeed FUD. There are very real serious issues with AI alignment but this doesn't seem like one to me.

>Having the perfect friend is actually immensely scary. It will create a world where people interact mostly with their electronic AI friends and where people no longer rely on each other. It is very unlikely that there will be any fabric of society left at that point, and people will start to hate the existence of other people...

It's not clear that current society is that great and it's going to have to change to adapt a future AI or we will certainly disappear. From a purely utilitarian perspective if AI friends replace real ones but net happiness goes up this would be a fantastic success. Certainly relative to other possible AI dystopias.

>The best thing that could happen would be the dismantling of all these tech companies by physically destroying all their servers and backups, just as we have done with huge stockpiles of nuclear weapons.

You can't really think this a possible or reasonable undertaking. Luddism isn't going to save us. Not to mention your example is one where that process has completely failed and Nukes are still ubiquitous.

> You can't really think this a possible or reasonable undertaking. Luddism isn't going to save us.

Yes, I do. I believe forsaking a lot of new technology and curbing technological innovation is an excellent way to further humanity. I blog about it and write a newsletter and talk to anyone who will listen.

>Yes, I do. I believe forsaking a lot of new technology and curbing technological innovation is an excellent way to further humanity.

The problem is that the cat is out of the bag. We didn't pass laws saying you can't make chip foundries and now they are all over the world. Even a Nation State would have issues destroying all of them and now the reality is that even non-ideal architectures can be used to train models. So it's just not possible to stop progress. Even if you blew up every fab in the world some clever hackers are going to string together 100 Tesla Model S' or 20,000 smart fridges and train a Neural Net on them.

Blowing up fabs to stop progress is just not going to work not to mention the devastating effects it would have on the rest of the economy.

I find your positive scenario extremely frightening, even more so your approval of it. It would literally be the Matrix scenario coming true.

Also, I'll have imperfect friends, thanks.

The answer - make it free and open. We can't afford it being monopolised.
Given that AI ethics is already a huge and growing problem, perhaps it's good that OpenAI's tech would be dismissed as just another tool for corporate control over our lives.