zookini comments on Redundant Attention Heads in Large Language Models For In Context Learning

[zookini]

each previous example confirming the pattern attends to the $i$th example, and adds a constant update term (equivilant to $\log \left(c\right)+norm$) to the $i$th example.

Nit: should be \log(c) - norm