Read http://www.spaceandgames.com/?p=22 if you haven’t already. Your utility function should not be assigning things arbitrarily large additive utilities, or else you get precisely this problem (if pigs qualify as minds, use rocks), and your function will sum to infinity. If you “kill” by destroying the exact same information content over and over, it doesn’t seem to be as bad, or even bad at all. If I made a million identical copies of you, froze them into complete stasis, and then shot 999,999 with a cryonics-proof Super-Plasma-Vaporizer, would this be immoral? It would certainly be less immoral than killing a million ordinary individuals, at least as far as I see it.
“Congratulations, you made my brain asplode.”
Read http://www.spaceandgames.com/?p=22 if you haven’t already. Your utility function should not be assigning things arbitrarily large additive utilities, or else you get precisely this problem (if pigs qualify as minds, use rocks), and your function will sum to infinity. If you “kill” by destroying the exact same information content over and over, it doesn’t seem to be as bad, or even bad at all. If I made a million identical copies of you, froze them into complete stasis, and then shot 999,999 with a cryonics-proof Super-Plasma-Vaporizer, would this be immoral? It would certainly be less immoral than killing a million ordinary individuals, at least as far as I see it.