lc comments on On second thought, prompt injections are probably examples of misalignment

[lc]

But how do you get the model to think the special tokens aren’t also part of the “prompt”? Like, how do you get it to react to them differently?