ryan_greenblatt comments on Coup probes: Catching catastrophes with probes trained off-policy

[ryan_greenblatt]

(Note that in this work, we’re just doing supervised probing though we do use models to generate some of the training data.)