For example, if a human says “I’d like to make a similar brain as mine, but with 80% more neurons per cortical minicolumn”, there’s no way to actually do that, at least not without spending decades or centuries on basic bio-engineering research.
By contrast, if an ANN-based AGI says “I’d like to make a similar ANN as mine, but with 80% more neurons per layer”, they can actually do that experiment immediately.
First, some types of software can be largely additive wrt their variables, e.g. neural nets, that’s basically why SGD works. Second, software has lots of other huge advantages like rapid iteration times, copyability and inspectability of intermediate states.
Why the disagree vote?
For example, if a human says “I’d like to make a similar brain as mine, but with 80% more neurons per cortical minicolumn”, there’s no way to actually do that, at least not without spending decades or centuries on basic bio-engineering research.
By contrast, if an ANN-based AGI says “I’d like to make a similar ANN as mine, but with 80% more neurons per layer”, they can actually do that experiment immediately.
First, some types of software can be largely additive wrt their variables, e.g. neural nets, that’s basically why SGD works. Second, software has lots of other huge advantages like rapid iteration times, copyability and inspectability of intermediate states.