ryan_greenblatt comments on [Paper] Stress-testing capability elicitation with password-locked models

[ryan_greenblatt]

We agree:

Using unsupervised behavior discovery+RL on password-locked models (we bet it works well) and trying to build password-locked models that are robust to this method.