I think this is the main problem. And for domains like finance that concentrate wealth a lot (enabling capture of the political decisionmaking system), the system has to be designed extremely well to avoid runaway alignment problems.
I think this is the main problem. And for domains like finance that concentrate wealth a lot (enabling capture of the political decisionmaking system), the system has to be designed extremely well to avoid runaway alignment problems.