johnswentworth comments on Updating the Lottery Ticket Hypothesis

[johnswentworth]

Not quite. The linear expansion isn’t just over the parameters associated with one layer, it’s over all the parameters in the whole net.