Valentin Baltadzhiev comments on Why do we need an understanding of the real world to predict the next tokens in a body of text?

[Valentin Baltadzhiev]

I think I understand, thank you. For reference, this is the tweet which sparked the question: https://​​twitter.com/​​RichardMCNgo/​​status/​​1735571667420598737

I was confused as to why you would necessarily need “understanding” and not just simple next token prediction to do what ChatGPT does