I agree with you that an entity with different goals would behave differently, and that evolution’s “goal” isn’t (entirely) the same as my goals.
However, there’s a sense of coherence with the physical world that I admire about evolution’s decisions, and I want to emulate that coherence in choosing my own goals.
The fact that evolution values “duplicate perfectly, then destroy original” equivalently to “teleport” isn’t a conclusive argument I should value them equivalently, but it’s a suggestive argument towards that conclusion. The fact that my evolutionary environment never contained anything like that is suggestive that my gut feeling about it isn’t likely to be helpful.
The balance of evidence seems to be against any such thing as continuous experience existing—an adaptive illusion analogous to the blind spot. Valuing continuous experience highly just doesn’t seem to cut nature at its joints.
I agree with you that an entity with different goals would behave differently, and that evolution’s “goal” isn’t (entirely) the same as my goals.
However, there’s a sense of coherence with the physical world that I admire about evolution’s decisions, and I want to emulate that coherence in choosing my own goals.
The fact that evolution values “duplicate perfectly, then destroy original” equivalently to “teleport” isn’t a conclusive argument I should value them equivalently, but it’s a suggestive argument towards that conclusion. The fact that my evolutionary environment never contained anything like that is suggestive that my gut feeling about it isn’t likely to be helpful.
The balance of evidence seems to be against any such thing as continuous experience existing—an adaptive illusion analogous to the blind spot. Valuing continuous experience highly just doesn’t seem to cut nature at its joints.