Consider the package deal to include getting your brain rewired so that you would receive pleasure from the end of mankind. Now do you choose the package deal?
I wouldn’t. Can you explain to me why I wouldn’t, if you believe the only thing I can want is pleasure?
Maybe you’re hyperbolically discounting that future pleasure and it’s outweighed by the temporary displeasure caused by agreeing to something abhorrent? ;)
Maybe you’re hyperbolically discounting that future pleasure and it’s outweighed by the temporary displeasure caused by agreeing to something abhorrent? ;)
I think that if an FAI scanned ArisKatsaris’ brain, extrapolated values from that, and then was instructed to extrapolate what a non-hyperboli- discounting ArisKatsaris would choose, it would answer that ArisKatsaris would not choose to get rewired to receive pleasure from the end of mankind.
Of course, there’s no way to test such a hypothesis.
Plus we have a hard time conceiving of what it would be like to always be in a state of maximal, beyond-orgasmic pleasure.
When I imagine it I cannot help but let a little bit of revulsion, fear, and emptiness creep into the feeling—which of course would not be actually be there. This invalidates the whole thought experiment to me, because it’s clear I’m unable to perform it correctly, and I doubt I’m uncommon in that regard.
Maybe you’re hyperbolically discounting that future pleasure and it’s outweighed by the temporary displeasure caused by agreeing to something abhorrent? ;)
I think that if an FAI scanned ArisKatsaris’ brain, extrapolated values from that, and then was instructed to extrapolate what a non-hyperboli- discounting ArisKatsaris would choose, it would answer that ArisKatsaris would not choose to get rewired to receive pleasure from the end of mankind.
Of course, there’s no way to test such a hypothesis.
Plus we have a hard time conceiving of what it would be like to always be in a state of maximal, beyond-orgasmic pleasure.
When I imagine it I cannot help but let a little bit of revulsion, fear, and emptiness creep into the feeling—which of course would not be actually be there. This invalidates the whole thought experiment to me, because it’s clear I’m unable to perform it correctly, and I doubt I’m uncommon in that regard.