Each game she is maximizing not just to win that game, but to also win future games against the same players.
This sounded really wrong to me. Like, what is the analogy in real life? I am a good guy today, but I predict that I may become a criminal tomorrow, so I am already optimizing to make it difficult to figure out?
But I suppose, in real life, circumstances also change, so things that are not criminal today may become criminal tomorrow, so you can be a good guy today and also optimize to make yourself safe when the circumstances change, even if your values won’t.
This sounded really wrong to me. Like, what is the analogy in real life? I am a good guy today, but I predict that I may become a criminal tomorrow, so I am already optimizing to make it difficult to figure out?
But I suppose, in real life, circumstances also change, so things that are not criminal today may become criminal tomorrow, so you can be a good guy today and also optimize to make yourself safe when the circumstances change, even if your values won’t.