Thanks for your comment! On further reflection I think you’re right about the difference between LLM hallucinations and what’s commonly meant when humans refer to “hallucination.” I think maybe the better comparison is between LLMs and human confabulation, which would be seen in something like Korsakoff syndrome, where anterograde and retrograde amnesia result in the tendency to invent memories that have no basis in reality to fill a gap.
I guess to progress from here I’ll need to take a dive into neural entropy.
Thanks for your comment! On further reflection I think you’re right about the difference between LLM hallucinations and what’s commonly meant when humans refer to “hallucination.” I think maybe the better comparison is between LLMs and human confabulation, which would be seen in something like Korsakoff syndrome, where anterograde and retrograde amnesia result in the tendency to invent memories that have no basis in reality to fill a gap.
I guess to progress from here I’ll need to take a dive into neural entropy.