GPT-4 is arguably way past human intelligence already
Well, it’s only been a month. But if it were that brilliant, I think we’d hear about it performing feats that are recognisably works of genius.
The main superhuman advantages of GPTs that are discernible to me, are speed of thought, and breadth of knowledge.
In my own experiments, the single most impressive cognitive act might have been a suggestion from Bing, regarding how to combine a number of alignment strategies. It ingeniously noticed that each alignment method pertained to a different level of cognitive organization, opening the possibility that they could be applied simultaneously.
I think that to a great extent, genius relies on repeated examples of such ingenious creativity, combined with successful analysis. But this was just an isolated flash of creativity, not one step in a larger process.
If GPT-4-based agents can begin to regularly produce that kind of creativity from their GPT-4 component, and harness it in intricate purposeful activity—then they’ll truly be on their way to higher intelligence.
My point is that we couldn’t tell if it were genius. If it’s incredibly smart in domains we don’t understand or care about, it wouldn’t be recognisably genius.
Thanks for link! Doing factor analysis is a step above just eyeballing it, but even that’s anthropomorphic if the factors are derived from performance on very human tasks. The more objective (but fuzzy) notion of intelligence I have in mind is something about efficiently halving some mathematical term for “weighted size of search space”.
Well, it’s only been a month. But if it were that brilliant, I think we’d hear about it performing feats that are recognisably works of genius.
The main superhuman advantages of GPTs that are discernible to me, are speed of thought, and breadth of knowledge.
In my own experiments, the single most impressive cognitive act might have been a suggestion from Bing, regarding how to combine a number of alignment strategies. It ingeniously noticed that each alignment method pertained to a different level of cognitive organization, opening the possibility that they could be applied simultaneously.
I think that to a great extent, genius relies on repeated examples of such ingenious creativity, combined with successful analysis. But this was just an isolated flash of creativity, not one step in a larger process.
If GPT-4-based agents can begin to regularly produce that kind of creativity from their GPT-4 component, and harness it in intricate purposeful activity—then they’ll truly be on their way to higher intelligence.
Meanwhile, AI psychometricians might want to consider models of intelligence that distinguish between many types of cognitive skill (if they aren’t doing that already).
My point is that we couldn’t tell if it were genius. If it’s incredibly smart in domains we don’t understand or care about, it wouldn’t be recognisably genius.
Thanks for link! Doing factor analysis is a step above just eyeballing it, but even that’s anthropomorphic if the factors are derived from performance on very human tasks. The more objective (but fuzzy) notion of intelligence I have in mind is something about efficiently halving some mathematical term for “weighted size of search space”.