seems kinda hard to make something formal to me because the basic argument is, i think, “there’s really a lot of ways for a model to do well in training”, but i don’t know how one is supposed to formalize that. i guess i’m curious where you think the force of formality comes in for the analogous argument when it comes to python programs
This may not be easily formalizable, but this does seem easily testable? Like, whats wrong with just training a bunch of different models, and seeing if they have similar generalization properties? If they’re radically different, then there’s many ways of doing well in training. If they’re pretty similar, then there’s very few ways of doing well in training.
This may not be easily formalizable, but this does seem easily testable? Like, whats wrong with just training a bunch of different models, and seeing if they have similar generalization properties? If they’re radically different, then there’s many ways of doing well in training. If they’re pretty similar, then there’s very few ways of doing well in training.