If the question is “how subagents can do superintelligently complex thing in unified manner, given limited bandwidth”, they can run internal prediction markets like “which next action is good” or “what we are going to observe in next five seconds”, because prediction markets is a powerful and general information integration engine. Moreover, it can lead to better mind integration, because some subagents can make a profit via exploiting incoherence in beliefs/decision-making.
Sure, right. (There are some theories suggesting that the human brain does something like a bidding process with the subagents with the best track record for prediction winning the ability to influence things more, though of course the system is different from an actual prediction market.) That’s significantly different from the system ceasing to meaningfully have subagents at all though, and I understood rorygreig to be suggesting that it might cease to have them.
Don’t understand what you’re saying? (I mean sure they can but what makes you bring that up.)
If the question is “how subagents can do superintelligently complex thing in unified manner, given limited bandwidth”, they can run internal prediction markets like “which next action is good” or “what we are going to observe in next five seconds”, because prediction markets is a powerful and general information integration engine. Moreover, it can lead to better mind integration, because some subagents can make a profit via exploiting incoherence in beliefs/decision-making.
Sure, right. (There are some theories suggesting that the human brain does something like a bidding process with the subagents with the best track record for prediction winning the ability to influence things more, though of course the system is different from an actual prediction market.) That’s significantly different from the system ceasing to meaningfully have subagents at all though, and I understood rorygreig to be suggesting that it might cease to have them.
Technically, every cell in the human body is a subagent trying to ‘predict’ each other’s future movements and actions.