I agree. Prime Intellect is absolutely friendly in that most important sense of caring about the continued existence and well-being of humans.
It was a good story, but I’m not sure that humans would have actually behaved as in that universe. Or we only saw a small subset of that universe. For example, we saw no one make themselves exponentially smarter. No one cloned themselves. No people merged consciousnesses. No one tried to convince Prime Intellect to reactivate the aliens inside of a zoo that allowed them to exist and for humanity to interact with them, without the danger of the aliens gaining control of Technology.
If I could choose between waiting around for Eliezer to make Friendly AI (or fail), I would choose the universe of Prime Intellect in a heartbeat. I don’t see why Fun Theory doesn’t apply there.
Actually, I’m more tempted to say that he was friendly, just not generally intelligent enough. Some of the humans seemed really silly, though…
I’ve no idea what extrapolated volition would mean in a population with that many freaks :-)
I agree. Prime Intellect is absolutely friendly in that most important sense of caring about the continued existence and well-being of humans.
It was a good story, but I’m not sure that humans would have actually behaved as in that universe. Or we only saw a small subset of that universe. For example, we saw no one make themselves exponentially smarter. No one cloned themselves. No people merged consciousnesses. No one tried to convince Prime Intellect to reactivate the aliens inside of a zoo that allowed them to exist and for humanity to interact with them, without the danger of the aliens gaining control of Technology.
If I could choose between waiting around for Eliezer to make Friendly AI (or fail), I would choose the universe of Prime Intellect in a heartbeat. I don’t see why Fun Theory doesn’t apply there.