I would distinct between 1), the “actual encoding”, and 2), the “morality that is implied by the rules of the game”, to which the “encoded” stuff would converge in some number of tens or hundreds of thousands of years through biological evolution, if the rules of the game didn’t change recently on the timescales that are orders of magnitude shorter :)
I would distinct between 1), the “actual encoding”, and 2), the “morality that is implied by the rules of the game”, to which the “encoded” stuff would converge in some number of tens or hundreds of thousands of years through biological evolution, if the rules of the game didn’t change recently on the timescales that are orders of magnitude shorter :)
Ok, so what you mean by 2) is something like reflective game-theoretic equilibrium for that particular environment (including social environment)?
Yes