If arguments about acausal trade and value handshakes hold, then the resulting utility function might contain some fraction of human values.
I think Paul’s Hail Mary via Solomonoff prior idea is not obviously related to acausal trade. (It does not privilege agents that engage in acausal trade over ones that don’t.)
I think Paul’s Hail Mary via Solomonoff prior idea is not obviously related to acausal trade. (It does not privilege agents that engage in acausal trade over ones that don’t.)
I agree. The sentence quoted is a separate observation.