It can’t represent a subjective sense of yellow, because if so, consciousness would be a linear function. That’s somewhat ridiculous because I would experience a story about a “dog” differently based on the context.
Furthermore, LLMs scale “features” by how strongly they appear (e.g. the positive sentiment vector is scaled up if the text is very positive). So the LLM’s conscious processing of a positive sentiment would be linearly proportional to how positive the text is. Which also seems ridiculous.
I don’t expect consciousness to have any useful properties. Let’s say you have a deterministic function y = f(x). You can encode just y = f(x), or y = f(x) where f includes conscious representations in the intermediate layers. The latter does not help you achieve increased training accuracy in the slightest. Neural networks also have a strong simplicity bias towards low frequency functions (this has been mathematically proven), and f(x) without consciousness is much simpler/lower frequency to encode than f(x) with consciousness.
It can’t represent a subjective sense of yellow, because if so, consciousness would be a linear function. That’s somewhat ridiculous because I would experience a story about a “dog” differently based on the context.
Furthermore, LLMs scale “features” by how strongly they appear (e.g. the positive sentiment vector is scaled up if the text is very positive). So the LLM’s conscious processing of a positive sentiment would be linearly proportional to how positive the text is. Which also seems ridiculous.
I don’t expect consciousness to have any useful properties. Let’s say you have a deterministic function y = f(x). You can encode just y = f(x), or y = f(x) where f includes conscious representations in the intermediate layers. The latter does not help you achieve increased training accuracy in the slightest. Neural networks also have a strong simplicity bias towards low frequency functions (this has been mathematically proven), and f(x) without consciousness is much simpler/lower frequency to encode than f(x) with consciousness.