You’ve done a better analysis of completions than me, but I don’t agree with your view that the claim is inconsequential. I think it’s not obvious that post is only about reduced diversity in fine tuned models.
“Inconsequential” is too strong; I changed to “critical.”
I think this isn’t very important for the explicit arguments in the OP (given that the model does in fact have extremely low entropy), but it contributes to a general anti-text-davinci-002 and anti-RLHF vibe that might be a lot of what readers take away from the piece.
You’ve done a better analysis of completions than me, but I don’t agree with your view that the claim is inconsequential. I think it’s not obvious that post is only about reduced diversity in fine tuned models.
“Inconsequential” is too strong; I changed to “critical.”
I think this isn’t very important for the explicit arguments in the OP (given that the model does in fact have extremely low entropy), but it contributes to a general anti-text-davinci-002 and anti-RLHF vibe that might be a lot of what readers take away from the piece.
It’s not critical, agreed.