Jett Janiak comments on Transformers Represent Belief State Geometry in their Residual Stream

[Jett Janiak]

For the two sets of mess3 parameters I checked the stationary distribution was uniform.