Yes. Also it says on Marcus’s Wikipedia page he founded 2 AI startups, one in 2015 and another in 2019. It is an unreasonable view to believe he doesn’t understand transformers.
Marcus tried other techniques that evidently didn’t work well enough (SOTA for robotics is now a variation on transformers).
Hinton seems to have partial credit for back propagation and recent credit for capsule networks which work but also didn’t work well enough.
Of course Marcus also calls Hinton old in his response, Hinton is 24 years older.
Yes. Also it says on Marcus’s Wikipedia page he founded 2 AI startups, one in 2015 and another in 2019. It is an unreasonable view to believe he doesn’t understand transformers.
Marcus tried other techniques that evidently didn’t work well enough (SOTA for robotics is now a variation on transformers).
Hinton seems to have partial credit for back propagation and recent credit for capsule networks which work but also didn’t work well enough.
Of course Marcus also calls Hinton old in his response, Hinton is 24 years older.