Where governance is the barrier to human flourishing, doesn’t that mean that using AI to improve governance is useful? A transhuman mind might well be able to figure out not only better policies but how to get those policies enacted (persuasion, force, mind control, incentives, something else we haven’t thought of yet). After all, if we’re worried about a potentially unfriendly mind with the power to defeat the human race, the flip side is that if it’s friendly, it can defeat harmful parts of the human race, like poorly-run governments.
Where governance is the barrier to human flourishing, doesn’t that mean that using AI to improve governance is useful? A transhuman mind might well be able to figure out not only better policies but how to get those policies enacted (persuasion, force, mind control, incentives, something else we haven’t thought of yet). After all, if we’re worried about a potentially unfriendly mind with the power to defeat the human race, the flip side is that if it’s friendly, it can defeat harmful parts of the human race, like poorly-run governments.