lukaemon comments on Actually, Othello-GPT Has A Linear Emergent World Representation

[lukaemon]

In hindsight, I should have trained on layer 6, which is the point where the board state is fully computed and starts to really be used.

You mean layer 4?

[Neel Nanda]

Ah, yep, typo