Buck comments on An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2

[Buck]

Thanks! I agree that thinking through the idealized induction head algorithm seems healthy, but I think it seems important to know that that algorithm isn’t much of what those heads are actually doing!