@author—thank you for this fascinating exploration. I’m appreciating your intuition that there might be some interesting structures there and your ability to point to their shape through this research. It seems helpful to have some sense of the ways LLM may exhibit features/behaviours/geographies that we didn’t knowingly ‘put there’ and that are not easily noticeable.
@Shayne—Can you expand on ‘Literary analysis however probably works dramatically better. Thus maybe it might be worth looking at the works of literature critics’?
From what I’m understanding of what your comment is caring for, I don’t actually think that the approach you’re suggesting here gets you richer/more meaningful findings—structuralism provides its own extremely context-specific (both in time and culture) framing of the symbolic meaning landscape it’s concerned with. By comparison, the archetypes you find in the major arcana are pretty steeped in the cultural roots that have underpinned much of the you’re proposing to scrutinise instead, and is made up of figures that would have been more foundationally influential in the substrate of today’s Western culture (especially with its combination of cosmological influences). Therefore, it seems to me from the way you’ve phrased your comment that you would propose a shallower tool, essentially, which doesn’t strike me as more helpful in making sense of how an LLM might derive a blueprint of human cosmology.
Also, if the data that shaped the embedding space was all English language text, I think we’re lying to ourselves somewhat if we’re expecting a diverse, non-Western-centric cosmology to emerge from this kind of analysis. I agree with you that using Lévi-Strauss’ frameworks as another track could still be worthwhile, but heeding the previous sentence rather than thinking that the right lens can cure a lack that’s actually in the object we’re exploring.
Finally, can you clarify what you mean by your very first observation, please?
Ok. I must have missed this reply, my apologies for the late response.
There are elements of how embedding spaces that parallel the way studies of semiotics suggest human meaning production works. Similarities cluster, differences define clear boundaries of meaning and so on.
The reason I suggests literary theory, is because largely thats a widely documented field of study with academic standards, and its one that is more strongly aware of how meanings and associations map onto cultural cohorts (Ie tarot symbols would be meaningless to chinese folks, whereas i-ching might be more meaningful to those chinese folks) However literary theory is more interested in the structures of those meanings with ideas whos fundamental units are things like Metaphors, Metonyms, Opposition, Categories and so on.
@author—thank you for this fascinating exploration. I’m appreciating your intuition that there might be some interesting structures there and your ability to point to their shape through this research. It seems helpful to have some sense of the ways LLM may exhibit features/behaviours/geographies that we didn’t knowingly ‘put there’ and that are not easily noticeable.
@Shayne—Can you expand on ‘Literary analysis however probably works dramatically better. Thus maybe it might be worth looking at the works of literature critics’?
From what I’m understanding of what your comment is caring for, I don’t actually think that the approach you’re suggesting here gets you richer/more meaningful findings—structuralism provides its own extremely context-specific (both in time and culture) framing of the symbolic meaning landscape it’s concerned with. By comparison, the archetypes you find in the major arcana are pretty steeped in the cultural roots that have underpinned much of the you’re proposing to scrutinise instead, and is made up of figures that would have been more foundationally influential in the substrate of today’s Western culture (especially with its combination of cosmological influences). Therefore, it seems to me from the way you’ve phrased your comment that you would propose a shallower tool, essentially, which doesn’t strike me as more helpful in making sense of how an LLM might derive a blueprint of human cosmology.
Also, if the data that shaped the embedding space was all English language text, I think we’re lying to ourselves somewhat if we’re expecting a diverse, non-Western-centric cosmology to emerge from this kind of analysis. I agree with you that using Lévi-Strauss’ frameworks as another track could still be worthwhile, but heeding the previous sentence rather than thinking that the right lens can cure a lack that’s actually in the object we’re exploring.
Finally, can you clarify what you mean by your very first observation, please?
Ok. I must have missed this reply, my apologies for the late response.
There are elements of how embedding spaces that parallel the way studies of semiotics suggest human meaning production works. Similarities cluster, differences define clear boundaries of meaning and so on.
The reason I suggests literary theory, is because largely thats a widely documented field of study with academic standards, and its one that is more strongly aware of how meanings and associations map onto cultural cohorts (Ie tarot symbols would be meaningless to chinese folks, whereas i-ching might be more meaningful to those chinese folks) However literary theory is more interested in the structures of those meanings with ideas whos fundamental units are things like Metaphors, Metonyms, Opposition, Categories and so on.