The big one is obviously “make long time scale plans to navigate a complicated 3D environment, while controlling a floppy robot.”
I agree with Qumeric’s comment—the point is that the modern ML paradigm is incompatible with having a single scale for general intelligence. Even given the same amount of processing power as a human brain, modern ML would use it on a smaller model with a simpler architecture, that gets exposed to orders of magnitude more training data, and that training data would be pre-gathered text or video (or maybe a simple simulation) that could be fed in at massive rates, rather than slow real-time anything.
The intelligences this produces are hard to put on a nice linear scale leading from ants to humans.
The big one is obviously “make long time scale plans to navigate a complicated 3D environment, while controlling a floppy robot.”
This is like judging a dolphin on its tree-climbing ability and concluding it’s not as smart as a squirrel. That’s not what it was built for. In a large number of historically human domains, GPT-4 will dominate the village idiot and most other humans too.
Can you think of examples where it actually makes sense to compare GPT and the village idiot and the latter easily dominates? Language input/output is still a pretty large domain.
The big one is obviously “make long time scale plans to navigate a complicated 3D environment, while controlling a floppy robot.”
I agree with Qumeric’s comment—the point is that the modern ML paradigm is incompatible with having a single scale for general intelligence. Even given the same amount of processing power as a human brain, modern ML would use it on a smaller model with a simpler architecture, that gets exposed to orders of magnitude more training data, and that training data would be pre-gathered text or video (or maybe a simple simulation) that could be fed in at massive rates, rather than slow real-time anything.
The intelligences this produces are hard to put on a nice linear scale leading from ants to humans.
This is like judging a dolphin on its tree-climbing ability and concluding it’s not as smart as a squirrel. That’s not what it was built for. In a large number of historically human domains, GPT-4 will dominate the village idiot and most other humans too.
Can you think of examples where it actually makes sense to compare GPT and the village idiot and the latter easily dominates? Language input/output is still a pretty large domain.