gwern comments on A Mechanistic Interpretability Analysis of Grokking

[gwern]

Possibly also of interest: https://​​cprimozic.net/​​blog/​​reverse-engineering-a-small-neural-network/​​