johnswentworth comments on [AN #139]: How the simplicity of reality explains the success of neural nets

[johnswentworth]

I believe the paper says that log densities are (approximately) polynomial—e.g. a Gaussian would satisfy this, since the log density of a Gaussian is quadratic.