That might work. Maybe have the adversarial network try to distinguish GPT-3 text from human text? That said, GPT-3 is already trying to predict humanlike text continuations, so there’s a decent chance that having a separate GAN layer wouldn’t help. It’s probably worth doing the experiment though; traditional GANs work by improving the discriminator as well as the desired categorizer, so there’s a chance it could work here too.
That might work. Maybe have the adversarial network try to distinguish GPT-3 text from human text? That said, GPT-3 is already trying to predict humanlike text continuations, so there’s a decent chance that having a separate GAN layer wouldn’t help. It’s probably worth doing the experiment though; traditional GANs work by improving the discriminator as well as the desired categorizer, so there’s a chance it could work here too.