JBlack comments on Empowerment is (almost) All We Need

JBlack 24 Oct 2022 4:14 UTC
2 points
0
At least one of the following must be true:
1. Instrumental convergence to empowerment in realistic environments is false
2. Approximate empowerment intrinsic motivation is not useful for AGI
3. AGI will not learn models of self and others
4. The difference between Altruistic AGI and Selfish AGI reduces to using other-empowerment utility rather than self-empowerment utility
Why? It seems possible that all of them could be false, and I don’t see any compelling argument in the post concluding that at least one must be true.