It’s just that, despite the fact that all the pieces are there, it goes on being a not-obvious way to think, if for years and years you’ve heard about how we can only have objective theories if we can do experiments that are “in the territory” in the sense that they are outside of anyone’s map. [ Contrast with celebrity examples of “shared thought experiments” from which many people drew similar conclusions because they took place in a shared map—Singer’s Drowning Child, the Trolley Problem, Rawls’s Veil of Ignorance, Zeno’s story about Achilles and the Tortoise, Pascal’s Wager, Newcomb’s Problem, Parfit’s Hitchhiker, the St. Petersburg paradox, etc. ]
I think, in retrospect, the view that abstract statements about shared non-reductionist reality can be objectively sound-valid-and-therefore true follows pretty naturally from combining the common-on-LessWrong view that logical or abstract physical theories can make sound-valid-and-therefore-true abstract conclusions about Reality, with the view, also common on LessWrong, that we make a lot of decisions by modeling other people as copies of ourselves, instead of as entities primarily obeying reductionist physics.
It’s just that, despite the fact that all the pieces are there, it goes on being a not-obvious way to think, if for years and years you’ve heard about how we can only have objective theories if we can do experiments that are “in the territory” in the sense that they are outside of anyone’s map. [ Contrast with celebrity examples of “shared thought experiments” from which many people drew similar conclusions because they took place in a shared map—Singer’s Drowning Child, the Trolley Problem, Rawls’s Veil of Ignorance, Zeno’s story about Achilles and the Tortoise, Pascal’s Wager, Newcomb’s Problem, Parfit’s Hitchhiker, the St. Petersburg paradox, etc. ]