Yes, what’s immoral is the shoehorning. They would think that there is more to life than what they do, if only they were allowed freedom of thought.
One might think that it is possible to create human-level intelligence creatures that won’t think that way. But we’ve never seen such a species (yes, very small sample size), and I’m not convinced it is possible.
So in short you aren’t talking about a race of supersoldiers whose only purpose is really to fight wars for us, you’re talking about a race of supersoldiers who are pressured into believing that their only purpose is to fight wars for us, against their actual inner natures that would make them e.g. peaceful artists or musicians instead.
At this point, we’re not talking about remotely the same thing, we’re talking about completely opposite things—as opposite as fulfilling your true utility function and being forced to go against it—as opposite as Fun and Anti-Fun.
Yes, what’s immoral is the shoehorning. They would think that there is more to life than what they do, if only they were allowed freedom of thought.
One might think that it is possible to create human-level intelligence creatures that won’t think that way. But we’ve never seen such a species (yes, very small sample size), and I’m not convinced it is possible.
So in short you aren’t talking about a race of supersoldiers whose only purpose is really to fight wars for us, you’re talking about a race of supersoldiers who are pressured into believing that their only purpose is to fight wars for us, against their actual inner natures that would make them e.g. peaceful artists or musicians instead.
At this point, we’re not talking about remotely the same thing, we’re talking about completely opposite things—as opposite as fulfilling your true utility function and being forced to go against it—as opposite as Fun and Anti-Fun.