Joseph Bloom comments on Open Source Sparse Autoencoders for all Residual Stream Layers of GPT2-Small

[Joseph Bloom]

Makes sense. Will set off some runs with longer context sizes and track this in the future.