You will need to raise your $/hour in the VoI in order to pick and choose only the very highest-returning experiments. Both interesting outcomes.
I don’t think that follows. Suppose I’m considering two experiments, A with an estimated return of $100 and another B of $200; I muse that I should probably do the $200 B experiment first and only then A $100 (if ever). I then reflect that I have 10 readers who will follow the results, and logically I ought to multiply the returns by 10, to get A actually is worth $1,000 and B is actually worth $2,000. I then muse I should probably do… experiment B.
Choices between experiments aren’t affected by a constant factor applied equally to all experiments: the highest marginal return remains the highest marginal return. (If experiment B was the best one to do with no audience, then it’s still the best one to do with any audience.)
Where the audience would matter is if experiments interact with the audience: maybe no one cares about vitamin D but people are keenly interested in modafinil. Then the highest return could change based on how you use audience numbers.
I don’t think that follows. Suppose I’m considering two experiments, A with an estimated return of $100 and another B of $200; I muse that I should probably do the $200 B experiment first and only then A $100 (if ever). I then reflect that I have 10 readers who will follow the results, and logically I ought to multiply the returns by 10, to get A actually is worth $1,000 and B is actually worth $2,000. I then muse I should probably do… experiment B.
Choices between experiments aren’t affected by a constant factor applied equally to all experiments: the highest marginal return remains the highest marginal return. (If experiment B was the best one to do with no audience, then it’s still the best one to do with any audience.)
Where the audience would matter is if experiments interact with the audience: maybe no one cares about vitamin D but people are keenly interested in modafinil. Then the highest return could change based on how you use audience numbers.