That’s what happens when you take “thou shalt not modify thine own utility function” as a religious tenet.
Wrong, the “religious tenet” is not “thou shalt not modify thine own utility function”, but “minimize evil”. Of course, being changed to no longer care about minimizing evil is not conducive to minimizing evil.
Wrong, the “religious tenet” is not “thou shalt not modify thine own utility function”, but “minimize evil”. Of course, being changed to no longer care about minimizing evil is not conducive to minimizing evil.