Thanks for feedback. I know that it is difficult to avoid seeing the comments of others. The problem with e-mail is that it is marginally less convenient to do, and I was afraid that people would have not enough motivation to respond.
As for hiding the instructions, I don’t see a strong reason. I suppose priming is a strong enough effect to persist even if people know they are being tested for it.
As for hiding the instructions, I don’t see a strong reason.
If the coin flip puts me in group II, does not my inadvertently seeing the question intended for group I (e.g., “Is the population of the Central African Republic lower or greater than 20 million?”) de facto reassign me to group I? In other words, after I had been exposed to the anchor (20 million) would not my continued participation in the control group have undermined the purpose of the control group?
ADDED.
I suppose priming is a strong enough effect to persist even if people know they are being tested for it.
after I had been exposed to the anchor, would not my continued participation in the control group have undermined the purpose of the control group?
Agreed. It would have been better to always answer the group-II question first, whichever one you were assigned to. (That is, switch the part 1 group II question with the part 2 group I question.)
I have misunderstood you and thought you suggest that I hide parts of the original post.
I have expected that people follow on the links in the bottom of the post. If you click on the group II question link, you don’t see the group I question. Of course, if you scroll down, you will see it, but therefore I have warned against reading the comments.
As a positive data point, the instructions worked for me, and I think this is an interesting and well thought-out experiment—the method isn’t perfectly watertight, but that has to be balanced against making it easy and attractive for people to participate, as well as against the cost (in your time and energy) of setting it up. I think you struck a good balance.
Thanks for feedback. I know that it is difficult to avoid seeing the comments of others. The problem with e-mail is that it is marginally less convenient to do, and I was afraid that people would have not enough motivation to respond.
As for hiding the instructions, I don’t see a strong reason. I suppose priming is a strong enough effect to persist even if people know they are being tested for it.
If the coin flip puts me in group II, does not my inadvertently seeing the question intended for group I (e.g., “Is the population of the Central African Republic lower or greater than 20 million?”) de facto reassign me to group I? In other words, after I had been exposed to the anchor (20 million) would not my continued participation in the control group have undermined the purpose of the control group?
ADDED.
I tend to agree, but that’s not it.
Agreed. It would have been better to always answer the group-II question first, whichever one you were assigned to. (That is, switch the part 1 group II question with the part 2 group I question.)
I have misunderstood you and thought you suggest that I hide parts of the original post.
I have expected that people follow on the links in the bottom of the post. If you click on the group II question link, you don’t see the group I question. Of course, if you scroll down, you will see it, but therefore I have warned against reading the comments.
As a positive data point, the instructions worked for me, and I think this is an interesting and well thought-out experiment—the method isn’t perfectly watertight, but that has to be balanced against making it easy and attractive for people to participate, as well as against the cost (in your time and energy) of setting it up. I think you struck a good balance.