leogao comments on What’s up with LLMs representing XORs of arbitrary features?

[leogao]

The training set is a random 100k subsample of this dataset: https://​​huggingface.co/​​datasets/​​amazon_polarity

I’m prepending Alice/​Bob and doing the xor of the label in exactly the same way you do.