You are averaging based on the population at the start of the experiment. In essence, you are counting dead people in your average, like Eliezer’s offhanded comment implied he would
I consider every moment of living experience as of equal weight. You may call that “counting dead people” if you want, but that’s only because when considering the entire timeline I consider every living moment—given a single timeline, there’s no living people vs dead people, there’s just people living in different times. If you calculate the global population it doesn’t matter what country you live in—if you calculate the utility of a fixed timeline, it doesn’t matter what time you live in.
But the main thing I’m not sure you get is that I believe preferences are valid also when concerning the future, not just when concerning the present.
If 2014 Carl wants the state of the world to be X in 2024, that’s still a preference to be counted, even if Carl ends up dead in the meantime. That Carl severely does NOT want to be dead in 2024, means that there’s a heavy disutility penalty for the 2014 function of his utility if he ends up nonetheless dead in 2024.
Of course, if we counted their preferences, that would be a conservatizing force that we could never get rid of
If e.g. someone wants to be buried at sea because he loves the sea, I consider it good that we bury them at sea. But if someone wants to be buried at sea only because he believes such a ritual is necessary for his soul to be resurrected by God Poseidon, his preference is dependent on false beliefs—it doesn’t represent true terminal values; and that’s the ones I’m concerned about.
If conservatism is e.g. motivated by either wrong epistemic beliefs, or by fear, rather than true different terminal values, it should likewise not modify our actions, if we’re acting from an epistemically superior position (we know what they didn’t).
when considering the entire timeline I consider every living moment—given a single timeline, there’s no living people vs dead people, there’s just people living in different times. If you calculate the global population it doesn’t matter what country you live in—if you calculate the utility of a fixed timeline, it doesn’t matter what time you live in.
That’s an ingenious fix, but when I think about it I’m not sure it works. The problem is that although you are calculating the utility integrated over the timeline, the values that you are integrating are still based on a particular moment. In other words, calculating the utility of the 2014-2024 timeline by 2014 preferences might not produce the same result as calculating the utility of the 2014-2024 timeline by 2024 preferences. Worse yet, if you’re comparing two timelines and the two timelines have different 2024s in them, and you try to compare them by 2024 preferences, which timeline’s 2024 preferences do you use?
For instance, consider
timeline A: Carl is alive in 2014 and is killed soon afterwards, but two new people are born who are alive in 2024.
timeline B: Carl is alive in 2014 and in 2024, but the two people from A never existed.
If you compare the timelines by Carl’s 2014 preferences or Carl’s timeline B 2024 preferences, timeline B is better, because timeline B has a lot of utility integrated over Carl’s life.
If you compare the timelines by the other people’s timeline A 2024 preferences, timeline A is better.
It’s tempting to try to fix this argument by saying that rather than using preferences at a particular moment, you will use preferences integrated over the timeline, but if you do that in the obvious way (by weighting the preferences according to the person-hours spent with that preference), then killing someone early reduces the contribution of their preference to the integrated utility, causing a problem similar to the original one.
I consider every moment of living experience as of equal weight. You may call that “counting dead people” if you want, but that’s only because when considering the entire timeline I consider every living moment—given a single timeline, there’s no living people vs dead people, there’s just people living in different times. If you calculate the global population it doesn’t matter what country you live in—if you calculate the utility of a fixed timeline, it doesn’t matter what time you live in.
But the main thing I’m not sure you get is that I believe preferences are valid also when concerning the future, not just when concerning the present.
If 2014 Carl wants the state of the world to be X in 2024, that’s still a preference to be counted, even if Carl ends up dead in the meantime. That Carl severely does NOT want to be dead in 2024, means that there’s a heavy disutility penalty for the 2014 function of his utility if he ends up nonetheless dead in 2024.
If e.g. someone wants to be buried at sea because he loves the sea, I consider it good that we bury them at sea.
But if someone wants to be buried at sea only because he believes such a ritual is necessary for his soul to be resurrected by God Poseidon, his preference is dependent on false beliefs—it doesn’t represent true terminal values; and that’s the ones I’m concerned about.
If conservatism is e.g. motivated by either wrong epistemic beliefs, or by fear, rather than true different terminal values, it should likewise not modify our actions, if we’re acting from an epistemically superior position (we know what they didn’t).
That’s an ingenious fix, but when I think about it I’m not sure it works. The problem is that although you are calculating the utility integrated over the timeline, the values that you are integrating are still based on a particular moment. In other words, calculating the utility of the 2014-2024 timeline by 2014 preferences might not produce the same result as calculating the utility of the 2014-2024 timeline by 2024 preferences. Worse yet, if you’re comparing two timelines and the two timelines have different 2024s in them, and you try to compare them by 2024 preferences, which timeline’s 2024 preferences do you use?
For instance, consider timeline A: Carl is alive in 2014 and is killed soon afterwards, but two new people are born who are alive in 2024. timeline B: Carl is alive in 2014 and in 2024, but the two people from A never existed.
If you compare the timelines by Carl’s 2014 preferences or Carl’s timeline B 2024 preferences, timeline B is better, because timeline B has a lot of utility integrated over Carl’s life. If you compare the timelines by the other people’s timeline A 2024 preferences, timeline A is better.
It’s tempting to try to fix this argument by saying that rather than using preferences at a particular moment, you will use preferences integrated over the timeline, but if you do that in the obvious way (by weighting the preferences according to the person-hours spent with that preference), then killing someone early reduces the contribution of their preference to the integrated utility, causing a problem similar to the original one.
I think you’re arguing against my argument against a position you don’t hold, but which I called by a term that sounds to you like your position.
Assuming you have a function that yields the utility that one person has at one particular second, what do you want to optimize for?
And maybe I should wait until I’m less than 102 degrees Fahrenheit to continue this discussion.