I think the only error is to notice that the claim that GPT2 couldn’t have self-awareness (I agree, it still can’t) was incorrectly overgeneralized to also claim that the self-representation would be weak for all LM transformers. You did say the “technically,” so maybe no update is needed.
It’s probably not important. I just happened to be archive browsing for a couple minutes for an unrelated reason and ran across it.
I think the only error is to notice that the claim that GPT2 couldn’t have self-awareness (I agree, it still can’t) was incorrectly overgeneralized to also claim that the self-representation would be weak for all LM transformers. You did say the “technically,” so maybe no update is needed.
It’s probably not important. I just happened to be archive browsing for a couple minutes for an unrelated reason and ran across it.