I recently listened to Gary Marcus speak with Stuart Russell on the Sam Harris podcast (episode 312, “The Trouble With AI,” released on March 7th, 2023). Gary and Stuart seem to believe that current machine learning techniques are insufficient for reaching AGI, and point to the recent adversarial attacks on KataGo as one example. Given this position, I would like Gary Marcus to come up with a new set of prompts that (a) make GPT-4 look dumb and (b) mostly continue to work for GPT-5.
While this is all true, it’s worth pointing out that Stuart’s position was more nuanced and uncertain. He pushed back when Gary said it was obvious, and he mentioned that some prompts made him update in the opposite direction. I don’t think they should be lumped into the same epistemic box.
While this is all true, it’s worth pointing out that Stuart’s position was more nuanced and uncertain. He pushed back when Gary said it was obvious, and he mentioned that some prompts made him update in the opposite direction. I don’t think they should be lumped into the same epistemic box.
Agreed. Stuart was more open to the possibility that current techniques are enough.