That’s a good point—if a type of question on an IQ test shows variability from year to year, do psychologists say it’s a bad type of question and remove it from the test?
Yes. A high test-retest correlation is one of the most basic criteria for an IQ test question or any inventory/item intended to measure something which is considered reasonably stable. (If it can’t even measure itself, how is it going measure anything else?)
They do, but there are also efforts to develop tests that measure other important aspects of cognition, which have an important bearing on things like how well you can function in society and how much of a risk you are to other people (these tests are, more or less, measuring what the rationality community might refer to as rationality). See, for example, What Intelligence Tests Miss: The Psychology of Rational Thought by Keith Stanovich.
That’s a good point—if a type of question on an IQ test shows variability from year to year, do psychologists say it’s a bad type of question and remove it from the test?
Yes. A high test-retest correlation is one of the most basic criteria for an IQ test question or any inventory/item intended to measure something which is considered reasonably stable. (If it can’t even measure itself, how is it going measure anything else?)
As far as I understand, they do. Or they say that there are training effects and those count really count for the true IQ.
They do, but there are also efforts to develop tests that measure other important aspects of cognition, which have an important bearing on things like how well you can function in society and how much of a risk you are to other people (these tests are, more or less, measuring what the rationality community might refer to as rationality). See, for example, What Intelligence Tests Miss: The Psychology of Rational Thought by Keith Stanovich.