In worlds where brains are ultra-efficient, AGI necessarily becomes neuromorphic or brain-like, as brains are then simply what economically efficient intelligence looks like in practice, as constrained by physics.
I totally disagree. Firstly it may be that the brain is 99.9% efficient, and some totally different design is also 99.9% efficient. There can be several very different efficient ways to do things.
Secondly AGI can be less efficient and still FOOMy if it has enough energy and mass. As it is usually easier to do something at all than to do it with near perfect efficiency, early AGI’s will probably use more power than the human brain. In an extreme case given self replicating space robots and fusion reactors, the first AI could involve a truly vast amount of energy and mass.
I don’t actually think the human brain is anywhere near the fundamental limits.
I totally disagree. Firstly it may be that the brain is 99.9% efficient, and some totally different design is also 99.9% efficient. There can be several very different efficient ways to do things.
Secondly AGI can be less efficient and still FOOMy if it has enough energy and mass. As it is usually easier to do something at all than to do it with near perfect efficiency, early AGI’s will probably use more power than the human brain. In an extreme case given self replicating space robots and fusion reactors, the first AI could involve a truly vast amount of energy and mass.
I don’t actually think the human brain is anywhere near the fundamental limits.