Andrew Mack comments on Mechanistically Eliciting Latent Behaviors in Language Models

[Andrew Mack]

Yes, I meant the unsupervised steering objective (magnitude of downstream changes) as opposed to cross-entropy.

[tailcalled]

Fair, it’s eigenvectors should be equivalent to the singular vectors of the Jacobian.