back

by david927·3y ago·view on hn ↗
If you're thinking that we would create AGI but contain it and asking would it breech that containment? Yes, and in a trivial amount of time, in all cases.

The next question is, "Would it go on to end humanity?" No, I think not. I think that most destruction happens from a survival mindset. "For me to survive, it can't." I'm not sure we're looking at that here, in terms of AGI. I don't see that anything that we would create would be destructive to ensure its own survival.

The existential threat is before we get to AGI. And maybe that's what you're referring to -- a machine to source and produce paper clips that goes rogue and consumes all resources leaving a dead planet and mountains of paper clips.