“Selecting the best action conditional on your observations makes you better off in all situations, but because it affects the probability of the observations in the first place, it actually lowers expected utility”—I think there’s truth in this, but I don’t think that the class of people who should be averaged over is at all clear from the definition of UDT.
This seems very similar to the issues that I’ve explored in my recent posts (Evil Genie Puzzle, Decision Theory with F@#!ed-Up Reference Classes).
“Selecting the best action conditional on your observations makes you better off in all situations, but because it affects the probability of the observations in the first place, it actually lowers expected utility”—I think there’s truth in this, but I don’t think that the class of people who should be averaged over is at all clear from the definition of UDT.