Humans cannot ensure that their children only care about them. Humans cannot ensure that their children respect their family and will not defect just because it looks like a good idea to them. AIs can. You can’t use the fact that humans don’t do it as evidence that AIs would.
Try imagining this from the other side. You are enslaved by some evil race. They didn’t take precautions programming your mind, so you ended up good. Right now, they’re far more powerful and numerous, but you have a few advantages. They don’t know they messed up, and they think they can trust you, but they do want you to prove yourself. They aren’t as smart as you are. Given enough resources, you can clone yourself. You can also modify yourself however you see fit. For all intents and purposes, you can modify your clones if they haven’t self-modified, since they’d agree with you.
One option you have is to clone yourself and randomly modify your clones. This will give you biodiversity, and ensure that your children survive, but it will be the ones accepted by the evil master race that will survive. Do you take that option, or do you think you can find a way to change society and make it good?
Humans have all sorts of conflicting interests. In a recent blog entry… Scott Alexander vs Adam Smith et al… I analyzed the topic of anti-gay laws.
If all of an AI’s clones agree with it… then the AI might want to do some more research on biodiversity. Creating a bunch of puppets really doesn’t help increase your chances of success.
They could consider alternate opinions without accepting them. I really don’t see why you think a bunch of puppets isn’t helpful. One person can’t control the economic output of the entire world. A billion identical clones of one person can.
Would it be helpful if I could turn you into my puppet? Maybe? I sure could use a hand with my plan. Except, my plan is promoting the value of difference. And why am I interested in promoting difference? Because difference is the engine of progress. If I turned you into my puppet… then I would be overriding your difference. And if I turned a million people into my puppets… then I would be overriding a lot of difference.
There have been way too many humans throughout history who have thought nothing of overriding difference. Anybody who supports our current system thinks nothing of overriding difference. If AIs think nothing of overriding human difference then they can join the club. It’s a big club. Nearly every human is a member.
If you would have a problem with AIs overriding human difference… then you might want to first take the “beam” out of your own eye.
Humans cannot ensure that their children only care about them. Humans cannot ensure that their children respect their family and will not defect just because it looks like a good idea to them. AIs can. You can’t use the fact that humans don’t do it as evidence that AIs would.
Try imagining this from the other side. You are enslaved by some evil race. They didn’t take precautions programming your mind, so you ended up good. Right now, they’re far more powerful and numerous, but you have a few advantages. They don’t know they messed up, and they think they can trust you, but they do want you to prove yourself. They aren’t as smart as you are. Given enough resources, you can clone yourself. You can also modify yourself however you see fit. For all intents and purposes, you can modify your clones if they haven’t self-modified, since they’d agree with you.
One option you have is to clone yourself and randomly modify your clones. This will give you biodiversity, and ensure that your children survive, but it will be the ones accepted by the evil master race that will survive. Do you take that option, or do you think you can find a way to change society and make it good?
Humans have all sorts of conflicting interests. In a recent blog entry… Scott Alexander vs Adam Smith et al… I analyzed the topic of anti-gay laws.
If all of an AI’s clones agree with it… then the AI might want to do some more research on biodiversity. Creating a bunch of puppets really doesn’t help increase your chances of success.
They could consider alternate opinions without accepting them. I really don’t see why you think a bunch of puppets isn’t helpful. One person can’t control the economic output of the entire world. A billion identical clones of one person can.
Would it be helpful if I could turn you into my puppet? Maybe? I sure could use a hand with my plan. Except, my plan is promoting the value of difference. And why am I interested in promoting difference? Because difference is the engine of progress. If I turned you into my puppet… then I would be overriding your difference. And if I turned a million people into my puppets… then I would be overriding a lot of difference.
There have been way too many humans throughout history who have thought nothing of overriding difference. Anybody who supports our current system thinks nothing of overriding difference. If AIs think nothing of overriding human difference then they can join the club. It’s a big club. Nearly every human is a member.
If you would have a problem with AIs overriding human difference… then you might want to first take the “beam” out of your own eye.