if gains from trade between value systems are big, then a lot of value may come from ensuring that the AI engages in acausal trade
Yeah, that sounds right to me. Most of the value is probably spread between that and breaking out of our simulation, but I haven’t put much thought into it. There’s other crucial considerations too (e.g. how to deal with an infinite universe). Thanks for pointing out the nuanced ways that what I said was wrong, and I’ll reflect more on what true sentiment my inutions are pointing to (if the sentiment is indeed true at all).
Yeah, that sounds right to me. Most of the value is probably spread between that and breaking out of our simulation, but I haven’t put much thought into it. There’s other crucial considerations too (e.g. how to deal with an infinite universe). Thanks for pointing out the nuanced ways that what I said was wrong, and I’ll reflect more on what true sentiment my inutions are pointing to (if the sentiment is indeed true at all).