nostalgebraist comments on the scaling “inconsistency”: openAI’s new insight

[nostalgebraist]

I don’t think you’re completely missing something. This is the active learning approach, which gwern also suggested—see that thread for more.