I dunno. Goebbels is evil. I don’t think you are trying to say (correct me if I’m wrong here) that the problem with haphazard AI is evil. The problem is that it won’t be a moral being at all. All the people on that list are morally complicated individuals. My first reaction to the idea that they would be networked together is that they would probably get into some heated arguments. I really just don’t see Einstein and Goebbels getting along on any kind of project, and if I’m not imagining them with their moral qualities attached, then what’s the point of naming them in particular?
Maybe this is a workable alternative:
The AI could also make use of its unique, non-human architecture. If it existed as pure software, it could copy itself many times, training each copy at accelerated computer speed, and networking those copies together. Imagine a body of researchers many times bigger than the world’s entire scientific community, working without rest, communicating perfectly and instantaneously, and without regard for tenure. It could continue copying itself without limit, creating millions or billions of copies, if it needed large numbers of minds to brute-force a solution to any particular problem.
In any case, I wouldn’t put too much emphasis on the orthogonality thesis in this document. That’s sort of a fancy argument, and not one that’s likely to come up talking to the public. Movies kind of took care of that for you.
I dunno. Goebbels is evil. I don’t think you are trying to say (correct me if I’m wrong here) that the problem with haphazard AI is evil. The problem is that it won’t be a moral being at all. All the people on that list are morally complicated individuals. My first reaction to the idea that they would be networked together is that they would probably get into some heated arguments. I really just don’t see Einstein and Goebbels getting along on any kind of project, and if I’m not imagining them with their moral qualities attached, then what’s the point of naming them in particular?
Maybe this is a workable alternative:
In any case, I wouldn’t put too much emphasis on the orthogonality thesis in this document. That’s sort of a fancy argument, and not one that’s likely to come up talking to the public. Movies kind of took care of that for you.
Thanks! will think about that...