beren comments on The Singular Value Decompositions of Transformer Weight Matrices are Highly Interpretable

[beren]

Thanks for this! This was just a copy paste error and it’s fine in the colab. Have updated the post now with the correct visuals