Checking out Chris Olah’s group’s stuff from the last few years is probably a good place to start.
Some links:
https://transformer-circuits.pub/2022/toy_model/index.html
https://transformer-circuits.pub/2023/privileged-basis/index.html
https://transformer-circuits.pub/2023/monosemantic-features/index.html
perfect thankyou
Checking out Chris Olah’s group’s stuff from the last few years is probably a good place to start.
Some links:
https://transformer-circuits.pub/2022/toy_model/index.html
https://transformer-circuits.pub/2023/privileged-basis/index.html
https://transformer-circuits.pub/2023/monosemantic-features/index.html
perfect thankyou