Sandi comments on Transformers Represent Belief State Geometry in their Residual Stream

[Sandi]

Yep, that’s what I was trying to describe as well. Thanks!