gwern comments on Transformer language models are doing something more general

[gwern]

See also https://​​evjang.com/​​2021/​​10/​​23/​​generalization.html