Just noting some comment links for future reference:
The sequences are tragically flawed—based on some overconfident assumptions about the brain and AI which turned out to be incorrect.
CEV is probably against suicide, and so is human empowerment.
Evolution succeeded at alignment: humans are massively successful by IGF (inclusive genetic fitness) metrics, and some do actually optimize mentally for IGF.
Just noting some comment links for future reference:
The sequences are tragically flawed—based on some overconfident assumptions about the brain and AI which turned out to be incorrect.
CEV is probably against suicide, and so is human empowerment.
Evolution succeeded at alignment: humans are massively successful by IGF (inclusive genetic fitness) metrics, and some do actually optimize mentally for IGF.