I think Scott’s original story described scissor statements a bit differently. The people reading them thought “hmm, this isn’t controversial at all, this is just obviously true, maybe the scissor-statement-generator has a bug”. And then other people read the same statement and said it was obviously false, and controversy resulted. Like the black and blue vs white and gold dress, or yanny/laurel. Maybe today’s LLMs aren’t yet smart enough to come up with new such statements.
EDIT: I think one possible reason why LLMs have trouble with this kind of question (and really with any question that requires coming up with specific interesting things) is that they have a bias toward generic. In my interactions with them at least, I keep having to constrain the question with specificity, and then the model will still try to give the most generic answer it can get away with.
I think Scott’s original story described scissor statements a bit differently. The people reading them thought “hmm, this isn’t controversial at all, this is just obviously true, maybe the scissor-statement-generator has a bug”. And then other people read the same statement and said it was obviously false, and controversy resulted. Like the black and blue vs white and gold dress, or yanny/laurel. Maybe today’s LLMs aren’t yet smart enough to come up with new such statements.
EDIT: I think one possible reason why LLMs have trouble with this kind of question (and really with any question that requires coming up with specific interesting things) is that they have a bias toward generic. In my interactions with them at least, I keep having to constrain the question with specificity, and then the model will still try to give the most generic answer it can get away with.