Genes being concentrated geographically is a fascinating idea, thanks for the book recommendation, I’ll definitely have a look.
Niceness does seem like the easiest to explain with our current frameworks, and it makes me think about whether there is scope to train agents in shared environments where they are forced to play iterated games with either other artificial agents or us. Unless an AI can take immediate decisive action, as in a fast take-off scenario, it will, at least for a while, need to play repeated games. This does seem to be covered under the idea that powerful AI would be deceptive, and pretend to play nice until it didn’t have to, but somehow our evolutionary environment led to the evolution of actual care for others’ wellbeing rather than only very sophisticated long-term deception abilities.
I remember reading about how we evolved emotional reactions that are purposefully hard to fake, such as crying, in a sort of arms race against deception, I believe it’s in How the Mind Works. This reminds me somewhat of that, where areas where people have genuine care for each other’s well beings are more likely to propagate the genes concentrated there.
Genes being concentrated geographically is a fascinating idea, thanks for the book recommendation, I’ll definitely have a look.
Niceness does seem like the easiest to explain with our current frameworks, and it makes me think about whether there is scope to train agents in shared environments where they are forced to play iterated games with either other artificial agents or us. Unless an AI can take immediate decisive action, as in a fast take-off scenario, it will, at least for a while, need to play repeated games. This does seem to be covered under the idea that powerful AI would be deceptive, and pretend to play nice until it didn’t have to, but somehow our evolutionary environment led to the evolution of actual care for others’ wellbeing rather than only very sophisticated long-term deception abilities.
I remember reading about how we evolved emotional reactions that are purposefully hard to fake, such as crying, in a sort of arms race against deception, I believe it’s in How the Mind Works. This reminds me somewhat of that, where areas where people have genuine care for each other’s well beings are more likely to propagate the genes concentrated there.