Tomek Korbak comments on Pretraining Language Models with Human Preferences

[Tomek Korbak]

I’m guessing that poison-pilling the <|bad|> sentences would have a negative effect on the <|good|> capabilities as well?

That would be my guess too.