Like, a big part of our deal is that the ‘just need to say something is straightforwardly wrong’ is something you are making up. It is just in your mind. The Paperclip Maximizer would trade the human race for a paperclip, and that isn’t ‘wrong’ in any absolute sense.
‘Wrong’ for you means something different than it does for Clippy. You can deny that that is relativism if you like, I’m not huge on labels. The key thing is that you get that there is no dif between you picking what is ‘right’ and Clippy picking what is ‘clippiest’. They are both value judgements created by moral systems.
Like, a big part of our deal is that the ‘just need to say something is straightforwardly wrong’ is something you are making up. It is just in your mind. The Paperclip Maximizer would trade the human race for a paperclip, and that isn’t ‘wrong’ in any absolute sense.
‘Wrong’ for you means something different than it does for Clippy. You can deny that that is relativism if you like, I’m not huge on labels. The key thing is that you get that there is no dif between you picking what is ‘right’ and Clippy picking what is ‘clippiest’. They are both value judgements created by moral systems.