###I don’t think that feedforward networks can be conscious
Integrated information theory does not allow for conscious feedforward networks.
###There is no good reason to expect AGI to be a recurrent neural network
Transformer models like GPT are basically feedforward networks [to do: check that this is correct]. Recurrent neural networks have had some successes but they are difficult to train. Whereas feedforward networks can be trained quite effectively using back-propagation. Biological neural networks are unable to implement back-propagation and instead rely on a variant of Hebbian Learning. To implement a recurrent neural network trained via Hebbian Learning on a computer wouldn’t necessarily be the best use of computational resources. AGI may very well be a feedforward network trained using back-prop.
###Anthropics
All of human consciousness is about to be massively dwarfed by an enormous explosion of superintelligent, highly conscious AIs. And by some incredible co-incidence I happen to be human???
It just seems so implausible. An explosion of unconscious or minimally conscious superintelligent AIs is much more plausible.
##AGI might not be conscious
###I don’t think that feedforward networks can be conscious
Integrated information theory does not allow for conscious feedforward networks.
###There is no good reason to expect AGI to be a recurrent neural network
Transformer models like GPT are basically feedforward networks [to do: check that this is correct]. Recurrent neural networks have had some successes but they are difficult to train. Whereas feedforward networks can be trained quite effectively using back-propagation. Biological neural networks are unable to implement back-propagation and instead rely on a variant of Hebbian Learning. To implement a recurrent neural network trained via Hebbian Learning on a computer wouldn’t necessarily be the best use of computational resources. AGI may very well be a feedforward network trained using back-prop.
###Anthropics All of human consciousness is about to be massively dwarfed by an enormous explosion of superintelligent, highly conscious AIs. And by some incredible co-incidence I happen to be human???
It just seems so implausible. An explosion of unconscious or minimally conscious superintelligent AIs is much more plausible.