Thank you for correcting the size of the human genome. I have fixed the number.
My claim is indeed “that [early stopping] reduce[s] the ‘effective’ complexity of the model to less than the entropy of the training data”. I consider such big data methods to be in a separate, data-inefficient category separate from Bayesian learning methods. Thus, “[f]or Bayesian learning methods, it is certainly not true that the complexity of the model must be limited to the entropy of the data set”.
Thank you for correcting the size of the human genome. I have fixed the number.
My claim is indeed “that [early stopping] reduce[s] the ‘effective’ complexity of the model to less than the entropy of the training data”. I consider such big data methods to be in a separate, data-inefficient category separate from Bayesian learning methods. Thus, “[f]or Bayesian learning methods, it is certainly not true that the complexity of the model must be limited to the entropy of the data set”.