Tom Lieberum comments on JumpReLU SAEs + Early Access to Gemma 2 SAEs

[Tom Lieberum]

We use 1024, though often article snippets are shorter than that so they are separated by BOS.