Yeah. The way I’m thinking about it is: to discuss these questions we have to get clear on what we mean by “knowledge” in the context of GPT. In some sense Gwern is right; in a different sense, you’re right. But no one has offered a clearer definition of “knowledge” to attempt to arbitrate these questions yet (afaik, that is).
Yeah. The way I’m thinking about it is: to discuss these questions we have to get clear on what we mean by “knowledge” in the context of GPT. In some sense Gwern is right; in a different sense, you’re right. But no one has offered a clearer definition of “knowledge” to attempt to arbitrate these questions yet (afaik, that is).