I’m aware that current artificial neural nets very much do have recurrent processing, and very interested in getting a proper understanding of how exactly feedback loops in artificial vs. natural neural nets differ in their implementation and function, because I suspect actually understanding that would be one way to get actual progress on whether sentient AI is a genuine risk or not. Like, a single feedback connection likely can’t do that much, and the different ways they can be implemented might matter. At which point exactly does the qualitative character of the system change with a massive improvement in performance? In my example above, I assumed that this was first just done to improve efficiency in getting responses already available, but that in the long run, it enabled minds to develop completely novel responses. I wonder if there is a similar transition in artificial systems.
Note that weight sharing (which is what I call reusing a neuron) also helps with statistical efficiency. That is, it takes less data to fit the weight to a certain accuracy.
I’m aware that current artificial neural nets very much do have recurrent processing, and very interested in getting a proper understanding of how exactly feedback loops in artificial vs. natural neural nets differ in their implementation and function, because I suspect actually understanding that would be one way to get actual progress on whether sentient AI is a genuine risk or not. Like, a single feedback connection likely can’t do that much, and the different ways they can be implemented might matter. At which point exactly does the qualitative character of the system change with a massive improvement in performance? In my example above, I assumed that this was first just done to improve efficiency in getting responses already available, but that in the long run, it enabled minds to develop completely novel responses. I wonder if there is a similar transition in artificial systems.
Note that weight sharing (which is what I call reusing a neuron) also helps with statistical efficiency. That is, it takes less data to fit the weight to a certain accuracy.