Ask LLMs for feedback on “the” rather than “my” essay/response/code, to get more critical feedback.
Seems true anecdotally, and prompting GPT-4 to give a score between 1 and 5 for ~100 poems/stories/descriptions resulted in an average score of 4.26 when prompted with “Score my …” versus an average score of 4.0 when prompted with “Score the …” (code).
‘Grade’ has an implicit context of more thorough criticism than ‘score.’
Also, obviously it would help to have a CoT prompt like “grade this essay, laying out the pros and cons before delivering the final grade between 1 and 5”
Ask LLMs for feedback on “the” rather than “my” essay/response/code, to get more critical feedback.
Seems true anecdotally, and prompting GPT-4 to give a score between 1 and 5 for ~100 poems/stories/descriptions resulted in an average score of 4.26 when prompted with “Score my …” versus an average score of 4.0 when prompted with “Score the …” (code).
Perhaps it’d be even better to say that it’s okay to be direct or even harsh?
Rate my ex’s poem.
Could try ‘grade this’ instead of ‘score the.’
‘Grade’ has an implicit context of more thorough criticism than ‘score.’
Also, obviously it would help to have a CoT prompt like “grade this essay, laying out the pros and cons before delivering the final grade between 1 and 5”