Suppose you use CEV, as originally proposed. And lets make the plausible, but not certain, assumption that the universe is truely finite. CEV is roughly an average of the utility functions of all current humans. I think most moral theories, other than some extreme forms of utilitarianism, would say that killing a person and replacing them with a new person is bad.
You can’t get total reproductive freedom in a finite universe. If society doesn’t stop you, physics will. So either you can let anyone reproduce as much as they want, and get a Malthusian catastrophe, or you limit reproduction. So pick a population that you can comfortably support for a long time, and go for that. You can be very nice about this limit. Plenty of existing human minds want children (and maybe a few grandchildren.) But most humans have no strong desire for a huge number of distant descendants. So phase out the desire to reproduce. (And the humans keen on children can be kept too busy keeping track of their existing children to reproduce too much.)
The resources aren’t infinite, but they are large. So any system that cares about us a little bit will send a lot of resources our way. Even if it is sending 99.9% of resources elsewhere. (Whether or not this is a good thing. Ie an AI that hates us a little bit will have enough resources to torture everyone.)
Suppose you use CEV, as originally proposed. And lets make the plausible, but not certain, assumption that the universe is truely finite. CEV is roughly an average of the utility functions of all current humans. I think most moral theories, other than some extreme forms of utilitarianism, would say that killing a person and replacing them with a new person is bad.
You can’t get total reproductive freedom in a finite universe. If society doesn’t stop you, physics will. So either you can let anyone reproduce as much as they want, and get a Malthusian catastrophe, or you limit reproduction. So pick a population that you can comfortably support for a long time, and go for that. You can be very nice about this limit. Plenty of existing human minds want children (and maybe a few grandchildren.) But most humans have no strong desire for a huge number of distant descendants. So phase out the desire to reproduce. (And the humans keen on children can be kept too busy keeping track of their existing children to reproduce too much.)
The resources aren’t infinite, but they are large. So any system that cares about us a little bit will send a lot of resources our way. Even if it is sending 99.9% of resources elsewhere. (Whether or not this is a good thing. Ie an AI that hates us a little bit will have enough resources to torture everyone.)