Pokemon is a game literally made to be played and beaten by children. Six years old might be pushing the lower bound, but it didn’t become one of the largest gaming and entertainment franchises in the world by being too difficult to play for children, whom the game is designed for.
Yes, kids get stuck and they do use extra resources like searching up info on game guides (old man moment, before the internet you had to find a friend who had the physical version and would let you borrow or look at it). But is the ability to search the internet the bottleneck that prevents Claude from getting past Mt. Moon in under 50 hours? That does not seem likely. In fact giving it access to the internet where it can get even more lost with potentially additional useless or irrelevant information could make the problem worse.
Yeah, I think that probably if the claim had been “worse than a 9 year old” then I wouldn’t have had much to complain about. I somewhat regret phrasing my original comment as a refutation of the “worse than a 6 year old” and “26 hour” claims, when really I was just using those as a jumping-off point to say some interesting-to-me stuff about how humans also get stuck on trivial obstacles in the same ways that AIs do.
I do feel like it’s a bit cleaner to factor apart Claude’s weaknesses into “memory,” “vision,” and “executive function” rather than bundling those issues together in the way the OP does at times. (Though obviously these are related, especially memory and executive function.) Then I would guess that Claude’s executive function actually isn’t that bad and might even be ≥human level. But it’s hard to say because the memory—especially visual memory—really does seem worse than a 6 year old’s.
I think that probably internet access would help substantially.
Pokemon is a game literally made to be played and beaten by children. Six years old might be pushing the lower bound, but it didn’t become one of the largest gaming and entertainment franchises in the world by being too difficult to play for children, whom the game is designed for.
Yes, kids get stuck and they do use extra resources like searching up info on game guides (old man moment, before the internet you had to find a friend who had the physical version and would let you borrow or look at it). But is the ability to search the internet the bottleneck that prevents Claude from getting past Mt. Moon in under 50 hours? That does not seem likely. In fact giving it access to the internet where it can get even more lost with potentially additional useless or irrelevant information could make the problem worse.
Yeah, I think that probably if the claim had been “worse than a 9 year old” then I wouldn’t have had much to complain about. I somewhat regret phrasing my original comment as a refutation of the “worse than a 6 year old” and “26 hour” claims, when really I was just using those as a jumping-off point to say some interesting-to-me stuff about how humans also get stuck on trivial obstacles in the same ways that AIs do.
I do feel like it’s a bit cleaner to factor apart Claude’s weaknesses into “memory,” “vision,” and “executive function” rather than bundling those issues together in the way the OP does at times. (Though obviously these are related, especially memory and executive function.) Then I would guess that Claude’s executive function actually isn’t that bad and might even be ≥human level. But it’s hard to say because the memory—especially visual memory—really does seem worse than a 6 year old’s.
I think that probably internet access would help substantially.