Jacob Pfau comments on LLMs are (mostly) not helped by filler tokens

[Jacob Pfau]

I’m currently working on filler token training experiments in small models. These GPT-4 results are cool! I’d be interested to chat.

[Kshitij Sachan]

Neat! I’ll reach out