Side comment from someone who knows a thing or two in psychology of argumentation:
1-I think that including back-and-forth in the argument (e.g. LLM debates or consulting) would have a significant effect. In general argumentation in-person vs on exposure showcases drastic différences.
2-In psychology of reasoning experiments, we sometimes observe that people are very confused about updates in “probability” (see −70% engineers, 30% lawyer, I pick someone at random. What’s the probability it’s one or the other -Fifty-fifty)
I wouldn’t be surprised if the results were different if you said “On a 0 to 10 scale where 0 is… And 10 is… Where do you stand”.
3-The way an argument is worded (claim first, data second, example third vs example first, data second, claim third) also has an impact, at least according to argumentation theory. In particular I recall that there were no concrete examples given in the arguments (e.g. “Bad llama”, “Devin”, “Sydney”, etc) which can give the impression of an incomplete argument.
Side comment from someone who knows a thing or two in psychology of argumentation:
1-I think that including back-and-forth in the argument (e.g. LLM debates or consulting) would have a significant effect. In general argumentation in-person vs on exposure showcases drastic différences.
2-In psychology of reasoning experiments, we sometimes observe that people are very confused about updates in “probability” (see −70% engineers, 30% lawyer, I pick someone at random. What’s the probability it’s one or the other -Fifty-fifty) I wouldn’t be surprised if the results were different if you said “On a 0 to 10 scale where 0 is… And 10 is… Where do you stand”.
3-The way an argument is worded (claim first, data second, example third vs example first, data second, claim third) also has an impact, at least according to argumentation theory. In particular I recall that there were no concrete examples given in the arguments (e.g. “Bad llama”, “Devin”, “Sydney”, etc) which can give the impression of an incomplete argument.