Second, if Eliezer is right and AI can develop from a simple seed someone can code up in their garage, that means powerful minds don’t need high K-complexity.
That may be somewhat misleading. A seed AI, denied access to external information, will be a moron. Yet the more information it takes into memory the higher the K-complexity of the thing, taken as a whole, is.
You might be able to code a relatively simple AI in your garage, but if it’s going to be useful it can’t stay simple.
ETA: Also if you take the computer system as a whole with all of the programming libraries and hardware arrangements—even ‘hello world’ would have high K-complexity. If you’re talking about whatsoever produces a given output on the screen in terms of a probability mass I’m not sure it’s reasonable to separate the two out and deal with K-complexity as simply a manifestation of high level APIs.
That may be somewhat misleading. A seed AI, denied access to external information, will be a moron. Yet the more information it takes into memory the higher the K-complexity of the thing, taken as a whole, is.
You might be able to code a relatively simple AI in your garage, but if it’s going to be useful it can’t stay simple.
ETA: Also if you take the computer system as a whole with all of the programming libraries and hardware arrangements—even ‘hello world’ would have high K-complexity. If you’re talking about whatsoever produces a given output on the screen in terms of a probability mass I’m not sure it’s reasonable to separate the two out and deal with K-complexity as simply a manifestation of high level APIs.
Relevant LW post.