How are OpenAI training these tokenizers?! I’m surprised they still have weird esoteric tokens like these in there, when presumably there’s eg a bunch of words that are worth learning
How are OpenAI training these tokenizers?! I’m surprised they still have weird esoteric tokens like these in there, when presumably there’s eg a bunch of words that are worth learning