Joseph Miller comments on The Residual Expansion: A Framework for thinking about Transformer Circuits

[Joseph Miller]

Actually I think the residual decomposition is incorrect—see my other comment.