I was assuming we’d need a human to write the hundreds of thousands of labels (e.g. “friend-in-the-Quaker-sense”)
As always, “Sampling can show the presence of knowledge but not its absence.” Self-distillation is witchcraft—I don’t blame people, even here, who I have to remind that it is in fact a thing. Works for a lot of stuff, whether it’s playing Starcraft or translating French or solving math or generating knowledge graphs...
As always, “Sampling can show the presence of knowledge but not its absence.” Self-distillation is witchcraft—I don’t blame people, even here, who I have to remind that it is in fact a thing. Works for a lot of stuff, whether it’s playing Starcraft or translating French or solving math or generating knowledge graphs...