But it can’t really be done the way you envision it. Variance in developer quality is high. Getting a meaningful result would require a lot more than 8 developers. And very few research groups can afford to run an experiment of that size—particularly since the usual experience in science is that you have to try the study a few times before you have the procedure right.
Yes, it would be nice to have such a study.
But it can’t really be done the way you envision it. Variance in developer quality is high. Getting a meaningful result would require a lot more than 8 developers. And very few research groups can afford to run an experiment of that size—particularly since the usual experience in science is that you have to try the study a few times before you have the procedure right.