Thank you! I think it’s exactly the same kind of “conditioning my output on their output” that you were pointing to in your analogy to iterated games. And I expect there’s a strong correspondence between “program equilibria where you only condition on predicted outputs” and “iterated game equilibria that can form a stable loop.”
It’s a shame I wasn’t able to use a time loop to have this exist when I wrote my post on Newcomb’s problem being an iterated PD.
This concept is exactly what I needed, and it’s explained far better than I did.
Thank you! I think it’s exactly the same kind of “conditioning my output on their output” that you were pointing to in your analogy to iterated games. And I expect there’s a strong correspondence between “program equilibria where you only condition on predicted outputs” and “iterated game equilibria that can form a stable loop.”