semiotic physics alludes to a lower level analysis: more analogous to studying neural firing dynamics on the human side than linguistics
Many classic debates in cognitive science and AI, e.g. between symbolism and connectionism, translate to claims about neural substrates. Most work with LLMs that I’ve seen abstracts over many such details, and seems in some ways more akin to linguistics, describing structure in high-level behavior, than neuroscience. It seems like there’s lots of overlap between what you’re talking about and Conceptual Role Semantics—here’s a nice, modern treatment of it in computational cognitive science.
I think I kind of get the use of “semiotics” more than “physics”. For example, with multi-modal LLMs the symbol/icon barrier begins to dissolve, so GPT-4 can reason about diagrams to some extent. The wikipedia entry for social physics provides some relevant context:
“More recently there have been a large number of social science papers that use mathematics broadly similar to that of physics, and described as “Computational social science”
Many classic debates in cognitive science and AI, e.g. between symbolism and connectionism, translate to claims about neural substrates. Most work with LLMs that I’ve seen abstracts over many such details, and seems in some ways more akin to linguistics, describing structure in high-level behavior, than neuroscience. It seems like there’s lots of overlap between what you’re talking about and Conceptual Role Semantics—here’s a nice, modern treatment of it in computational cognitive science.
I think I kind of get the use of “semiotics” more than “physics”. For example, with multi-modal LLMs the symbol/icon barrier begins to dissolve, so GPT-4 can reason about diagrams to some extent. The wikipedia entry for social physics provides some relevant context: