shen yue

• shen yue 26 Aug 2023 8:11 UTC

  1 point

  0

  on: In­duc­tion heads—illustrated

  Thanks for your hard work. I wonder why in the layer 0 attention head, the positions of the query and value are 1?