Adele Lopez comments on The “spelling miracle”: GPT-3 spelling abilities and glitch tokens revisited

[Adele Lopez]

Here’s a GPT2-Small neuron which appears to be detecting certain typos and misspellings (among other things)