Eliezer: as you are aware yourself, we don’t know how to compute it, nor how to run a computation that computes how to compute it. If we leave it up to the superintelligence to decide how to interpret “helping” and “hurting,” it will be in a position no worse than our own, and possibly better, seeing that we are not superintelligent.
Eliezer: as you are aware yourself, we don’t know how to compute it, nor how to run a computation that computes how to compute it. If we leave it up to the superintelligence to decide how to interpret “helping” and “hurting,” it will be in a position no worse than our own, and possibly better, seeing that we are not superintelligent.