Increasing intelligence and increasing cognitive capacity are two different things. If you take two hedge funds with 10 employees each, taken together they have double the cognitive capacity as one alone but not double the intelligence. We do see two headfunds with 10 employees each having double the results as one headfund with 10 employees.
Increasing intelligence is something that an AGI might do but it’s hard to do. On the other hand increasing cognitive capacity is just a matter of needing more hardware to have more instances running.
While I agree these are 2 different quantities when we say “intelligence test” we mean cognitive capacity. Every problem on an IQ test can be eventually solved by someone without gross brain deficits. They might need some weeks of training first to understand the “trick” a test maker looks for but after this they can solve every question. So an IQ test score measures problems solved by a time limit (that cannot provide enough time for any living human being to solve all questions or the test has an upper range it can measure) plotter on a gaussian.
So IQ testing an AI system will be tough since obviously it would need about a second to run all questions in parallel though however many stages of neural networks and other algorithms it uses. And then it will either miss a question because it doesn’t have the algorithm to answer one of a particular type or because it doesn’t have information that the test maker assumed all human beings would have.
While I agree these are 2 different quantities when we say “intelligence test” we mean cognitive capacity. Every problem on an IQ test can be eventually solved by someone without gross brain deficits.
What do you mean with “eventually solved”? It seems to me a strange way to think about test questions.
As in if there were no time limit and the test taker were allowed to read any reference that doesn’t directly have the answer and had unlimited lifespan and focus. Note also that harder iq test questions as they are written today in absolute terms the questions are wrong in that multiple valid solutions that satisfy all constraints exist. (With the usual cop out of “best” answer without defining the algorithm used to sort answers for best)
The MCAT and the dental one is another example of such a test. Every well prepared student has the ability to answer every question but there is a time limit.
There are intelligence tests where time alone gets you to be able to answer all correctly. There are others where you won’t reduce your errors to zero by spending more time. To the extend that it’s valuable for certain application of IQ testing to have a test that could be passed at maximum score that tells us nothing about the underlying nature of intelligence.
There are mental tasks that are complex and require you to hold a lot of information at the same time in your head. The mental task involved in making good GPJ-Open predictions is not one that’s just about spending more time.
Increasing intelligence and increasing cognitive capacity are two different things. If you take two hedge funds with 10 employees each, taken together they have double the cognitive capacity as one alone but not double the intelligence. We do see two headfunds with 10 employees each having double the results as one headfund with 10 employees.
Increasing intelligence is something that an AGI might do but it’s hard to do. On the other hand increasing cognitive capacity is just a matter of needing more hardware to have more instances running.
While I agree these are 2 different quantities when we say “intelligence test” we mean cognitive capacity. Every problem on an IQ test can be eventually solved by someone without gross brain deficits. They might need some weeks of training first to understand the “trick” a test maker looks for but after this they can solve every question. So an IQ test score measures problems solved by a time limit (that cannot provide enough time for any living human being to solve all questions or the test has an upper range it can measure) plotter on a gaussian.
So IQ testing an AI system will be tough since obviously it would need about a second to run all questions in parallel though however many stages of neural networks and other algorithms it uses. And then it will either miss a question because it doesn’t have the algorithm to answer one of a particular type or because it doesn’t have information that the test maker assumed all human beings would have.
What do you mean with “eventually solved”? It seems to me a strange way to think about test questions.
As in if there were no time limit and the test taker were allowed to read any reference that doesn’t directly have the answer and had unlimited lifespan and focus. Note also that harder iq test questions as they are written today in absolute terms the questions are wrong in that multiple valid solutions that satisfy all constraints exist. (With the usual cop out of “best” answer without defining the algorithm used to sort answers for best)
The MCAT and the dental one is another example of such a test. Every well prepared student has the ability to answer every question but there is a time limit.
There are intelligence tests where time alone gets you to be able to answer all correctly. There are others where you won’t reduce your errors to zero by spending more time. To the extend that it’s valuable for certain application of IQ testing to have a test that could be passed at maximum score that tells us nothing about the underlying nature of intelligence.
There are mental tasks that are complex and require you to hold a lot of information at the same time in your head. The mental task involved in making good GPJ-Open predictions is not one that’s just about spending more time.
A person can write things down, I suspect that an incorrect answer on a test with unlimited time is :
The person got bored and didn’t check enough to catch every error or didn’t possess a fact that the test writer expected every taker to know.
The question itself is wrong. (a correct question is one where after all constraints are applied one and only one answer exists)