If I understand Beren’s model correctly, [2] falls within the innate, hardcoded reward circuits in the hypothalamus and the brainstem.
Beren touches on [3] discussing them as attempted generalizations/extrapolations of [1] into a coherent framework, such as consequences, utility, adherence to some set of explicitly stated virtues, etc.
I would distinct between 1), the “actual encoding”, and 2), the “morality that is implied by the rules of the game”, to which the “encoded” stuff would converge in some number of tens or hundreds of thousands of years through biological evolution, if the rules of the game didn’t change recently on the timescales that are orders of magnitude shorter :)
If I understand Beren’s model correctly, [2] falls within the innate, hardcoded reward circuits in the hypothalamus and the brainstem.
Beren touches on [3] discussing them as attempted generalizations/extrapolations of [1] into a coherent framework, such as consequences, utility, adherence to some set of explicitly stated virtues, etc.
I would distinct between 1), the “actual encoding”, and 2), the “morality that is implied by the rules of the game”, to which the “encoded” stuff would converge in some number of tens or hundreds of thousands of years through biological evolution, if the rules of the game didn’t change recently on the timescales that are orders of magnitude shorter :)
Ok, so what you mean by 2) is something like reflective game-theoretic equilibrium for that particular environment (including social environment)?
Yes