dmz comments on High-stakes alignment via adversarial training [Redwood Research report]

[dmz]

I don’t think I believe a strong version of the Natural Abstractions Hypothesis, but nevertheless my guess is GPT-3 would do quite a bit better. We’re definitely interested in trying this.