MadHatter comments on Real-Time Research Recording: Can a Transformer Re-Derive Positional Info?

[MadHatter]

Yeah, just changing the max to a min produces this much smoother loss curve from your notebook..