I think the trouble with that argument is that it seems equally compelling for any useful capabilities, regardless of how achievable they are (eg it works for ‘deterministically simulate the behavior of the user’ even though that seems awfully unlikely to emerge in the foreseeable future). So I don’t think we can take it as evidence that we’ll see general reasoning emerge at any nearby scale.
I think the trouble with that argument is that it seems equally compelling for any useful capabilities, regardless of how achievable they are (eg it works for ‘deterministically simulate the behavior of the user’ even though that seems awfully unlikely to emerge in the foreseeable future). So I don’t think we can take it as evidence that we’ll see general reasoning emerge at any nearby scale.