Wei, would it be correct to say that, under your interpretation, if our universe initially contains 100 super happy people, that creating one more person who is “very happy” but not “super happy” is a net negative, because the “measure” of all the 100 super happy people gets slightly discounted by this new person?
It’s hard to see why I would consider this the right thing to do—where does this mysterious “measure” come from?
Eliezer, do you think it would be suitable for a blog post here?
Wei, would it be correct to say that, under your interpretation, if our universe initially contains 100 super happy people, that creating one more person who is “very happy” but not “super happy” is a net negative, because the “measure” of all the 100 super happy people gets slightly discounted by this new person?
It’s hard to see why I would consider this the right thing to do—where does this mysterious “measure” come from?
Eliezer, do you think it would be suitable for a blog post here?
Mm… sure. “Bias against uncomputability.”
That’s a much more general problem, the problem of whether to use sums or averages in utility calculations with changing population size.