johnswentworth comments on Why Neural Networks Generalise, and Why They Are (Kind of) Bayesian

[johnswentworth]

That’s exactly right. That exact example would be a case of high circuit size but low Kolmogorov complexity.