I think the connection between language modeling and Wittgenstein is a pretty clear one to make for philosophers, dating back before LLMs to more simplistic models like Word2Vec. But the people implementing them were generally not thinking about Wittgenstein—although many of them were thinking about connectionist models of the mind.
I think the connection between language modeling and Wittgenstein is a pretty clear one to make for philosophers, dating back before LLMs to more simplistic models like Word2Vec. But the people implementing them were generally not thinking about Wittgenstein—although many of them were thinking about connectionist models of the mind.