Andrew Quaisley comments on Research Report: Alternative sparsity methods for sparse autoencoders with OthelloGPT.

[Andrew Quaisley]

Oh, yeah, looks like with $p=2$ this is equivalent to Hoyer-Square. Thanks for pointing that out; I didn’t know this had been studied previously.

And you’re right, that was a typo, and I’ve fixed it now. Thank you for mentioning that!