I don’t think I can agree with the affirmation that NNs don’t have memory of previous training runs. It depends a bit on the definition of memory, but in the weights distribution there’s certainly some information stored about previous episodes which could be view as memory.
I don’t think memory in animals is much different, just that the neural network is much more complex. But memories do happen because updates in network structure, just as it happens in NNs during a RL training.
I don’t think I can agree with the affirmation that NNs don’t have memory of previous training runs. It depends a bit on the definition of memory, but in the weights distribution there’s certainly some information stored about previous episodes which could be view as memory.
I don’t think memory in animals is much different, just that the neural network is much more complex. But memories do happen because updates in network structure, just as it happens in NNs during a RL training.