Wait, increase utility according to what utility function?
The current CEV of humanity, or your best estimate of it, I think. If someone forces us to kill orphans or they’ll destroy the world, saving the world is higher utility, but we still want to punish the guy who made it so.
I think that’s where the idea came from, anyway; I agree with Yvain that it doesn’t work.
The current CEV of humanity, or your best estimate of it, I think. If someone forces us to kill orphans or they’ll destroy the world, saving the world is higher utility, but we still want to punish the guy who made it so.
I think that’s where the idea came from, anyway; I agree with Yvain that it doesn’t work.