I am slightly baffled that someone who has lucidly examined all of the ways in which corporations are horribly misaligned and principle-agent problems are everywhere, does not see the irony in saying that managing/regulating/policing those corporations will be similar to managing an AI supercluster totally united by the same utility function.
Different AIs run built and run by different organizations would have different utility functions and may face equal competition from one another, that’s fine. My problem is the part after that where he implies (says?) that the Google StockMaxx AI supercluster would face stiff competition from the humans at FBI & co.
I am slightly baffled that someone who has lucidly examined all of the ways in which corporations are horribly misaligned and principle-agent problems are everywhere, does not see the irony in saying that managing/regulating/policing those corporations will be similar to managing an AI supercluster totally united by the same utility function.
He says the “totally united by the same utility function” part is implausible:
Different AIs run built and run by different organizations would have different utility functions and may face equal competition from one another, that’s fine. My problem is the part after that where he implies (says?) that the Google StockMaxx AI supercluster would face stiff competition from the humans at FBI & co.
(I think) he thinks that managing/regulating/policing those corporations is the best that humans are willing to do.