It’s not that mysterious that they ended up as tokens. What’s puzzling is why so many completions to prompts asking GPT3 to repeat the “forbidden” token strings include them.
It’s not that mysterious that they ended up as tokens. What’s puzzling is why so many completions to prompts asking GPT3 to repeat the “forbidden” token strings include them.