Jett Janiak comments on Transformers Represent Belief State Geometry in their Residual Stream

[Jett Janiak]

This is such a cool result! I tried to reproduce it in this notebook