Neel Nanda comments on Real-Time Research Recording: Can a Transformer Re-Derive Positional Info?

[Neel Nanda]

Thanks! Yeah, I hadn’t seen that but someone pointed it out on Twitter. Feels like fun complimentary work