Yes, that's where I'm at. Can an AI hire a few individual humans to do its bidding? Absolutely, even if it wants people killed or buildings blown up. Can that scale? Absolutely not. There are natural breakpoints where "this AI keeps hiring people to do evil" is more noticeable and generates pushback. For instance, in a worst case scenari…
Yes, that's where I'm at. Can an AI hire a few individual humans to do its bidding? Absolutely, even if it wants people killed or buildings blown up. Can that scale? Absolutely not. There are natural breakpoints where "this AI keeps hiring people to do evil" is more noticeable and generates pushback. For instance, in a worst case scenario, you're not going to get enough people willing to exterminate all life on earth (or anywhere close to it). There's going to be a point where humanity unites to save itself from other humans, and they can succeed there. The AI will have to be able to finish the job (likely much more than 80% of the killing) without human assistance. No way humans allow other humans to kill even 20% without massive resistance.
We absolutely would shut down the internet to save 20% of the world population. To think otherwise doesn't understand humanity. I think the AI safety people are far too online to imagine a world without the internet, but humanity has no such limitation. The internet is new. I remember a full life before it existed, and we can do that again.
Yes, that's where I'm at. Can an AI hire a few individual humans to do its bidding? Absolutely, even if it wants people killed or buildings blown up. Can that scale? Absolutely not. There are natural breakpoints where "this AI keeps hiring people to do evil" is more noticeable and generates pushback. For instance, in a worst case scenario, you're not going to get enough people willing to exterminate all life on earth (or anywhere close to it). There's going to be a point where humanity unites to save itself from other humans, and they can succeed there. The AI will have to be able to finish the job (likely much more than 80% of the killing) without human assistance. No way humans allow other humans to kill even 20% without massive resistance.
We absolutely would shut down the internet to save 20% of the world population. To think otherwise doesn't understand humanity. I think the AI safety people are far too online to imagine a world without the internet, but humanity has no such limitation. The internet is new. I remember a full life before it existed, and we can do that again.