I think the other thing A/B tests are good for is giving you a feedback source that isn’t your design sense. Instead of “do I think this looks prettier?” you ask questions like “which do users click on more?”. (And this eventually feeds back into your design sense, making it stronger.)
I find this compelling (along with the “finding out which things matter that you didn’t realize mattered) and think this is a reason for us to begin doing A/B testing sometime in not too distant future.
I think the other thing A/B tests are good for is giving you a feedback source that isn’t your design sense. Instead of “do I think this looks prettier?” you ask questions like “which do users click on more?”. (And this eventually feeds back into your design sense, making it stronger.)
I find this compelling (along with the “finding out which things matter that you didn’t realize mattered) and think this is a reason for us to begin doing A/B testing sometime in not too distant future.