It can’t be too bad, though, because I have seen GPT-3 generate fairly plausible forum discussions with multiple participants, and how would it do that if it only ever saw single-commenter documents?
Do you have examples of that kind of output for comparison? (Is it reproducing formatting from an actual forum of some kind, or the additional “abstraction headroom” over GPT-2 allowing GPT-3 to output a forum-type structure without having matching examples in the training set?)
It can’t be too bad, though, because I have seen GPT-3 generate fairly plausible forum discussions with multiple participants, and how would it do that if it only ever saw single-commenter documents?
Do you have examples of that kind of output for comparison? (Is it reproducing formatting from an actual forum of some kind, or the additional “abstraction headroom” over GPT-2 allowing GPT-3 to output a forum-type structure without having matching examples in the training set?)
I didn’t copy it but it was fairly reasonable plaintext, something like username /n date /n comment /n /n next comment.