Neel Nanda comments on Linear encoding of character-level information in GPT-J token embeddings

[Neel Nanda]

We show that linear probes can retrieve much character-level information from embeddings and we ;.

You have a sentence fragment in the TLDR

[Joseph Bloom]

Fixed, thanks!