The thing is, such prophecies are all very wrong until they're very right. The idea of an LLM (with capabilities of e.g. <1 yr away) being given access to a VM and spinning up others without oversight, IMHO, is real enough. Biases like "omg it's gonna prefer western names in CVs" is a bit meh. The real stuff is not evident yet.
back
1 comments
>. The idea of an LLM (with capabilities of e.g. <1 yr away) being given access to a VM and spinning up others without oversight, IMHO, is real enough.
Is that really a danger? I can shut off a machine or VMs.
This line of argument indicates a basic refusal to take the threat model seriously, I think.
Should Google worry about Chinese state-backed attackers using attacking its systems to target dissidents or for corporate or military espionage? "Why, when they're using machines or VMs, and you can just shut those off?"
At a sophisticated-human level of capability, there are many established techniques to circumvent people trying to shut off your access to compute in general, or even to specific systems. It's certainly possible that AI will never reach a sophisticated-human level of capability at this task—it hasn't yet—but the fact that computers have off switches gives no information about the likelihood or proximity of reaching that threshold.