Logan Riggs comments on A Comprehensive Mechanistic Interpretability Explainer & Glossary

[Logan Riggs]

Unfinished line here

Implicit in the description of features as directions is that the feature can be represented as a scalar, and that the model cares about the range of this number. That is, it matters whether the feature