Choosing between “all humans CEV” and “all humans + extrapolation of uplifted minds” and “CEV of various future minds that we would value” is non-obvious for example.
Take an average.
Weighting the uncertainty and value of each CEV is non-obvious, so you’ve pushed the uncertainty up one level.
True, but it seems easier to compromise on.
Take an average.
Weighting the uncertainty and value of each CEV is non-obvious, so you’ve pushed the uncertainty up one level.
True, but it seems easier to compromise on.