wesg comments on A Mechanistic Interpretability Analysis of Grokking

[wesg]

Could you describe your inner thought loop when conducting these sorts of mechanistic analyses? I.e., What Are You Tracking In Your Head?