I think this is likely right by default in many settings, but I think ground-level truth does provide additional accuracy in predicting next tokens in at least some settings—such as in “Claim 1” in the post (but I don’t think that’s the only setting) -- and I suspect that will be enough for our purposes. But this is certainly related to stuff I’m actively thinking about.
I think this is likely right by default in many settings, but I think ground-level truth does provide additional accuracy in predicting next tokens in at least some settings—such as in “Claim 1” in the post (but I don’t think that’s the only setting) -- and I suspect that will be enough for our purposes. But this is certainly related to stuff I’m actively thinking about.