Humans do not have direct access to the implicit predictions of their brain’s language centers,
But various other human brain modules do have direct access to the outputs of linguistic cortex, and that is the foundation of most of our linguistic abilities, which surpass those of LLM in many ways.
Human linguistic cortex learns via word/token prediction, just like LLMs.
Human linguistic cortical outputs are the foundation for various linguistic abilities, performance of which follows on performance on 1.
Humans generally outperform LLMs on most downstream linguistic tasks.
I’m merely responding to this statement:
Language models are already superhuman at next token prediction
Which is misleading—LLMs are superhuman than humans at the next token prediction game, but that does not establish that LLMs are superhuman than human linguistic cortex (establishing that would require comparing neural readouts)
But various other human brain modules do have direct access to the outputs of linguistic cortex, and that is the foundation of most of our linguistic abilities, which surpass those of LLM in many ways.
Human linguistic cortex learns via word/token prediction, just like LLMs.
Human linguistic cortical outputs are the foundation for various linguistic abilities, performance of which follows on performance on 1.
Humans generally outperform LLMs on most downstream linguistic tasks.
I’m merely responding to this statement:
Which is misleading—LLMs are superhuman than humans at the next token prediction game, but that does not establish that LLMs are superhuman than human linguistic cortex (establishing that would require comparing neural readouts)