The problem is not so much which one of 1,2,3 to pick but whether ‘we’ get a chance to pick it at all. If there is space, free energy, and diversity, there will be evolution going on among populations and evolution will consistently push things in the direction towards more reproduction up until it hits a Malthusian limit at which point it will push towards greater competition and economic/reproductive efficiency. The only way to avoid this is to remove the preconditions for evolution—any of variation, selection, heredity—but these seem quite natural in a world of large AI populations so in practice this will require some level of centralized control
Variation corresponds to “a lot of people (in a broad sense potentially including Ems etc.) get to live independently”, selection corresponds to economic freedom, and heredity correspond to reproductive freedom. (Not exactly ofc, but it’s hard to write something which exactly matches any given frame.)
Or rather, it’s both a question of how to pick it and what to pick. Like the MIRI plan is to grab control over the world and then use this to implement some sort of cosmopolitan value system. But if one does so, there’s still the question of which cosmopolitan value system to implement.
The problem is not so much which one of 1,2,3 to pick but whether ‘we’ get a chance to pick it at all. If there is space, free energy, and diversity, there will be evolution going on among populations and evolution will consistently push things in the direction towards more reproduction up until it hits a Malthusian limit at which point it will push towards greater competition and economic/reproductive efficiency. The only way to avoid this is to remove the preconditions for evolution—any of variation, selection, heredity—but these seem quite natural in a world of large AI populations so in practice this will require some level of centralized control
Yes.
Variation corresponds to “a lot of people (in a broad sense potentially including Ems etc.) get to live independently”, selection corresponds to economic freedom, and heredity correspond to reproductive freedom. (Not exactly ofc, but it’s hard to write something which exactly matches any given frame.)
Or rather, it’s both a question of how to pick it and what to pick. Like the MIRI plan is to grab control over the world and then use this to implement some sort of cosmopolitan value system. But if one does so, there’s still the question of which cosmopolitan value system to implement.