Write semi-convincingly from the perspective of a non-mainstream political ideology, religion, philosophy, or aesthetic theory. The token weights are too skewed towards the training data.
This is something I’ve noticed GPT-3 isn’t able to do, after someone pointed out to me that GPT-3 wasn’t able to convincingly complete their own sentence prompts because it didn’t have that person’s philosophy as a background assumption.
I don’t know how to put that in terms of numbers, since I couldn’t really state the observation in concrete terms either.
Have you tried doing this with longer prompts, excerpted from some philosopher’s work or something? I’ve found it can do surprisingly well at matching tone on longer coherent prompts.
Write semi-convincingly from the perspective of a non-mainstream political ideology, religion, philosophy, or aesthetic theory. The token weights are too skewed towards the training data.
This is something I’ve noticed GPT-3 isn’t able to do, after someone pointed out to me that GPT-3 wasn’t able to convincingly complete their own sentence prompts because it didn’t have that person’s philosophy as a background assumption.
I don’t know how to put that in terms of numbers, since I couldn’t really state the observation in concrete terms either.
You should state specific philosophies. I don’t know what counts as mainstream enough.
Have you tried doing this with longer prompts, excerpted from some philosopher’s work or something? I’ve found it can do surprisingly well at matching tone on longer coherent prompts.