gwern comments on Characterizing stable regions in the residual stream of LLMs

[gwern]

Is this consistent with the interpretation of self-attention as approximating (large) steps in a Hopfield network?