Scott Alexander’s short story, The Demiurge’s Older Brother, explores a similar idea from the POV of simulation and acausal trade. This would be great for our prospects of survival if it’s true-in-general. Alignment would at least partially solve itself! And maybe it could be true! But we don’t know that. I personally estimate the odds of that as being quite low (why should I assume all possible minds would think that way?) at best. So, it makes sense to devote our efforts to how to deal with the possible worlds where that isn’t true.
Scott Alexander’s short story, The Demiurge’s Older Brother, explores a similar idea from the POV of simulation and acausal trade. This would be great for our prospects of survival if it’s true-in-general. Alignment would at least partially solve itself! And maybe it could be true! But we don’t know that. I personally estimate the odds of that as being quite low (why should I assume all possible minds would think that way?) at best. So, it makes sense to devote our efforts to how to deal with the possible worlds where that isn’t true.