Bill Benzon comments on The idea that ChatGPT is simply “predicting” the next word is, at best, misleading

[Bill Benzon]

Makes sense to me.

I wonder if those induction heads identified by the folks at Anthropic played a role in identifying those “high-level patterns/​structures in texts...”