True, I was just thinking that something that correlates (loosely) with “having made awesome stuff happen” might be better than something that correlates with “has one of multiple skills that contribute to the hypothetical ability to make awesome stuff happen”.
As for whether “making awesome stuff happen” is the right underlying metric… what else?
Well, for instance, given that Less Wrong is all about thinking better, there might be some interest in knowing something about (so to speak) the raw thinking power of the participants.
True, I was just thinking that something that correlates (loosely) with “having made awesome stuff happen” might be better than something that correlates with “has one of multiple skills that contribute to the hypothetical ability to make awesome stuff happen”.
As for whether “making awesome stuff happen” is the right underlying metric… what else?
Well, for instance, given that Less Wrong is all about thinking better, there might be some interest in knowing something about (so to speak) the raw thinking power of the participants.