“But considering an unlimited amount of ice cream forced me to confront the issue of what to do with any of it.”
“If you invoke the unlimited power to create a quadrillion people, then why not a quadrillion?”
“Say, the programming team has cracked the “hard problem of conscious experience” in sufficient depth that they can guarantee that the AI they create is not sentient—not a repository of pleasure, or pain, or subjective experience, or any interest-in-self—and hence, the AI is only a means to an end, and not an end in itself.”
“What is individually a life worth living?”
Really, is not the ultimate answer to the whole FAI issue encoded there?
IMO, the most important thing about AI is to make sure IT IS SENTIENT. Then, with very high probability, it has to consider the very same questions suggested here.
(And to make sure it does, make more of them and make them diverse. Majority will likely “think right” and supress the rest.)
“But considering an unlimited amount of ice cream forced me to confront the issue of what to do with any of it.”
“If you invoke the unlimited power to create a quadrillion people, then why not a quadrillion?”
“Say, the programming team has cracked the “hard problem of conscious experience” in sufficient depth that they can guarantee that the AI they create is not sentient—not a repository of pleasure, or pain, or subjective experience, or any interest-in-self—and hence, the AI is only a means to an end, and not an end in itself.”
“What is individually a life worth living?”
Really, is not the ultimate answer to the whole FAI issue encoded there?
IMO, the most important thing about AI is to make sure IT IS SENTIENT. Then, with very high probability, it has to consider the very same questions suggested here.
(And to make sure it does, make more of them and make them diverse. Majority will likely “think right” and supress the rest.)