Daniel Kokotajlo comments on NTK/​GP Models of Neural Nets Can’t Learn Features

[Daniel Kokotajlo]

I think I get this distinction; I realize the NN papers show the latter; I guess our disagreement is about how big a deal /​ how surprising this is.