This is redundant, but the point is important and I don’t want it to be overlooked because it’s buried at the bottom of a long comment.
Therefore, make many AIs, let them evolve and battle it out. The good will win vs. evil, because being moral, that is having better normative theories, increases biological fitness. So the more moral an AI is, the greater its chance to survive.
This is redundant, but the point is important and I don’t want it to be overlooked because it’s buried at the bottom of a long comment.
If you do that, everyone will die.