Andy Arditi comments on Refusal in LLMs is mediated by a single direction

[Andy Arditi]

Check out LEACE (Belrose et al. 2023) - their “concept erasure” is similar to what we call “feature ablation” here.