The difference between a person with an IQ of 90 and one with an IQ of 180 is not in gaps of knowledge or having access to information that’s right or wrong but in reasoning ability.
There are enormous differences in gaps of knowledge and further, self-selection into niches and lifestyles and skills like looking up information in Google Scholar, between an IQ 90 and a 180 person. Look at vocab norms or simple ordinary trivia questions such as ‘does the earth go around the sun or vice-versa?’. You can’t do much reasoning about what you don’t know about.
(This is one of the biggest reasons that ‘retrieval heavy’ LLMs have underperformed so much. There is no ‘small logical core’ you can easily cheaply learn free of actual real-world knowledge. At best, like the Phi series, you can steal reasoning from a much larger model like GPT-4 which learned it the hard way and has predigested it for you.)
There are enormous differences in gaps of knowledge and further, self-selection into niches and lifestyles and skills like looking up information in Google Scholar, between an IQ 90 and a 180 person. Look at vocab norms or simple ordinary trivia questions such as ‘does the earth go around the sun or vice-versa?’. You can’t do much reasoning about what you don’t know about.
(This is one of the biggest reasons that ‘retrieval heavy’ LLMs have underperformed so much. There is no ‘small logical core’ you can easily cheaply learn free of actual real-world knowledge. At best, like the Phi series, you can steal reasoning from a much larger model like GPT-4 which learned it the hard way and has predigested it for you.)