It probably doesn’t matter, but I wonder why you used the name “Sam” and then referred to this person as “she”. The name “Sam” is much more common for men than for women. So this kicks the text a bit “out of distribution”, which might affect things. In the worst case, the model might think that “Sam” and “she” refer to different people.
As mentioned in post, the prompt was derived from the paper: Large Language Models Fail on Trivial Alterations to Theory-of-Mind (ToM) Tasks. Even the paper shows that Sam is a girl in the illustration provided.
It probably doesn’t matter, but I wonder why you used the name “Sam” and then referred to this person as “she”. The name “Sam” is much more common for men than for women. So this kicks the text a bit “out of distribution”, which might affect things. In the worst case, the model might think that “Sam” and “she” refer to different people.
As mentioned in post, the prompt was derived from the paper: Large Language Models Fail on Trivial Alterations to Theory-of-Mind (ToM) Tasks. Even the paper shows that Sam is a girl in the illustration provided.