I for one do not see the benefit in getting superintelligences to follow the preferences of lesser, evolved intelligences. There’s no particular reason to believe that humans with access to the power granted by a superintelligence would make better choices than the superintelligence at all—or that their preferences would lead to states that their preferences would approve of, much less actually benefit them.
I for one do not see the benefit in getting superintelligences to follow the preferences of lesser, evolved intelligences. There’s no particular reason to believe that humans with access to the power granted by a superintelligence would make better choices than the superintelligence at all—or that their preferences would lead to states that their preferences would approve of, much less actually benefit them.