Here is a decent debunking of the notion that modern society is based on a social contract.
I agree with that.
More generally, Nick Szabo argues that the concept of sovereignty is itself totalitarian.
It certainly is. Where does that leave FAI? A superintelligent FAI, as envisaged by those who think it a desirable goal, will be a totalitarian absolute ruler imposing the CEVoH and will, to borrow Rousseau’s words, be “so strong as to render it impossible to suspend [its] operation.” Rather like the Super Happies’ plan for humanity. The only alternative to a superintelligent FAI is supposed to be a superintelligent UFAI.
I agree with that.
It certainly is. Where does that leave FAI? A superintelligent FAI, as envisaged by those who think it a desirable goal, will be a totalitarian absolute ruler imposing the CEVoH and will, to borrow Rousseau’s words, be “so strong as to render it impossible to suspend [its] operation.” Rather like the Super Happies’ plan for humanity. The only alternative to a superintelligent FAI is supposed to be a superintelligent UFAI.