Neel Nanda comments on Showing SAE Latents Are Not Atomic Using Meta-SAEs

[Neel Nanda]

The dataset for a meta SAE is literally the decoder directions of the original SAE, there are no tokens involved