That would just cause them to pump chemicals in you head, I think. But it’s definitely thinking in the right direction.
“number of dying humans” is really what you want to minimize.
Even with pseudo immortality, accidents happen, which means that the best way to minimize the number of dying humans is either to sterilize the entire species or to kill everyone. The goal shouldn’t be to minimize death but to maximize life.
Overwrite my current utility function upon your previous motivational networks, leaving no motivational trace of their remains.
That would just cause them to pump chemicals in you head, I think. But it’s definitely thinking in the right direction.
As long as I am not aware of that (or do not dislike it)… well, why not. However, MugaSofer is right, the genie has to understand the (future) utility function for that. But if it can alter the future without restrictions, it can change the utility function itself (maybe even to an unbounded one… :D)
Immortal humans can go horribly wrong, unless “number of dying humans” is really what you want to minimize.
“Increase my utility as much as you can”?
I said:
You replied:
I am well aware that this wish has major risks as worded. I was responding to the claim that “you can’t use that tool to solve that problem.”
Yes, obviously you wish for maximised utility. But that requires the genie to understand your utility.
That would just cause them to pump chemicals in you head, I think. But it’s definitely thinking in the right direction.
Even with pseudo immortality, accidents happen, which means that the best way to minimize the number of dying humans is either to sterilize the entire species or to kill everyone. The goal shouldn’t be to minimize death but to maximize life.
That actually seems like it’d work.
It wouldn’t do that (except in some sense in which it is able to do arbitrary things you don’t mean when given complicated or undefined requests).
As long as I am not aware of that (or do not dislike it)… well, why not. However, MugaSofer is right, the genie has to understand the (future) utility function for that. But if it can alter the future without restrictions, it can change the utility function itself (maybe even to an unbounded one… :D)