Thanks, I believe you are right. I really regret how much time and resources are wasted arguing over the extension / reference of a word.
I’d like to remark though that I was just trying to explain what I see as problematic in FiO. I wouldn’t only say that its conclusion is suboptimal (and I believe it is bad, and many people would agree); I also think that, given what Celestia can do, they got lucky (though lucky is not the adequate word when it comes to narratives) it didn’t end up in worse ways.
As I point out in a reply to shminux, I think it’s hard to see how an AI can maximize B’s preferences in an aligned way if B’s preferences and beliefs are inconsistent (temporally or modally). If B actually regards sim-B as another self, then its sacrifice is required; I believe that people who bite this bullet will tend to agree that FiO ends in a good way, even though they dislike “the process”.
Thanks, I believe you are right. I really regret how much time and resources are wasted arguing over the extension / reference of a word.
I’d like to remark though that I was just trying to explain what I see as problematic in FiO. I wouldn’t only say that its conclusion is suboptimal (and I believe it is bad, and many people would agree); I also think that, given what Celestia can do, they got lucky (though lucky is not the adequate word when it comes to narratives) it didn’t end up in worse ways.
As I point out in a reply to shminux, I think it’s hard to see how an AI can maximize B’s preferences in an aligned way if B’s preferences and beliefs are inconsistent (temporally or modally). If B actually regards sim-B as another self, then its sacrifice is required; I believe that people who bite this bullet will tend to agree that FiO ends in a good way, even though they dislike “the process”.