Regarding Evidential Cooperation in Large Worlds, the Identical Twin One Shot Prisoner’s dilemma makes sense to me because the entity giving the payout is connected to both worlds. What is the intuition for ECL (where my understanding is there isn’t any connection)?
The “entity giving the payout” in practice for ECL would be just the world states you end up in and requires you to care about the environment of the person you’re playing the PD with.
So, defecting might be just optimising my local environment for my own values and cooperating would be optimising my local environment for some aggregate of my own values and the values of the person I’m playing with. So, it only works if there are positive-sum aggregates and if each player cares about what the other does to their local environment.
Thanks for the interesting write-up.
Regarding Evidential Cooperation in Large Worlds, the Identical Twin One Shot Prisoner’s dilemma makes sense to me because the entity giving the payout is connected to both worlds. What is the intuition for ECL (where my understanding is there isn’t any connection)?
The “entity giving the payout” in practice for ECL would be just the world states you end up in and requires you to care about the environment of the person you’re playing the PD with.
So, defecting might be just optimising my local environment for my own values and cooperating would be optimising my local environment for some aggregate of my own values and the values of the person I’m playing with. So, it only works if there are positive-sum aggregates and if each player cares about what the other does to their local environment.