If they conclude that pleasure is worth experiencing, they’d self modify to feel more pleasure. Also, if we’re turned into paperclips but it makes the AI sufficiently happy, that seems good, if you agree with what I argue in the linked post.
If they conclude that pleasure is worth experiencing, they’d self modify to feel more pleasure. Also, if we’re turned into paperclips but it makes the AI sufficiently happy, that seems good, if you agree with what I argue in the linked post.