“If a really smart AI and powerful AI is told to maximize humanity’s happiness, fulfillment, and/or satisfaction, it will require us to specify that it must not do so by wiring car batteries to the brain’s pleasure centers using heroin/cocaine/etc.
Even if we specify that particular stipulation, it’ll probably think of another loophole or another way to cheat and boost the numbers higher than they’re supposed to go. If it’s smarter than a human, then all it takes is one glitch”
This is not for policymakers, as many of them are probably on cocaine.
“If a really smart AI and powerful AI is told to maximize humanity’s happiness, fulfillment, and/or satisfaction, it will require us to specify that it must not do so by
wiring car batteries to the brain’s pleasure centersusing heroin/cocaine/etc.Even if we specify that particular stipulation, it’ll probably think of another loophole or another way to cheat and boost the numbers higher than they’re supposed to go. If it’s smarter than a human, then all it takes is one glitch”
This is not for policymakers, as many of them are probably on cocaine.