“That deep learning systems are a kind of artifact produced by a few undifferentiated commodity inputs, one of which is called ‘parameters’, one called ‘compute’, and one called ‘data’, and that the details of these commodities aren’t important. Or that the details aren’t important to the people building the systems.”
That seems mostly true so far for the most capable systems? Of course, some details matter and there’s opportunity to do research on these systems now, but centrally it seems like you are much more able to forge ahead without a detailed understanding of what you’re doing than e.g. in the case of the Wright brothers.
“That deep learning systems are a kind of artifact produced by a few undifferentiated commodity inputs, one of which is called ‘parameters’, one called ‘compute’, and one called ‘data’, and that the details of these commodities aren’t important. Or that the details aren’t important to the people building the systems.”
That seems mostly true so far for the most capable systems? Of course, some details matter and there’s opportunity to do research on these systems now, but centrally it seems like you are much more able to forge ahead without a detailed understanding of what you’re doing than e.g. in the case of the Wright brothers.