Meta level. To carve nature at its joints, we must [use good nodes / identify the true nodes]. A node is [good insofar as / true if] its causes and effects are modular, or we can losslessly compress phenomena related to it into effects on it and effects from it.
“The cost of compute” is an example of a great node (in the context of the future of AI): it’s affected by various things (choices made by Nvidia, innovation, etc.), and it affects various things (capability-level of systems made by OpenAI, relative importance of money vs talent at AI labs, etc.), and we lose nothing by thinking in terms of the cost of compute (relative to, e.g., the effects of the choices made by Nvidia on the capability-level of systems made by OpenAI).
“When Moore’s law will end” is an example of something that is not a node (in the context of the future of AI), since you’d be much better off thinking in terms of the underlying causes and effects.
The relations relevant to nodes are analytical not causal. For example, “the cost of compute” is a node between “evidence about historical progress” and “timelines,” not just between “stuff Nvidia does” and “stuff OpenAI does.” (You could also make a causal model, but here I’m interested in analytical models.)
Object level. I’m not sure how good “timelines,” “takeoff,” “polarity,” and “wakeup to capabilities” are as nodes. Most of the time it seems fine to talk about e.g. “effects on timelines” and “implications of timelines.” But maybe this conceals confusion.
Meta level. To carve nature at its joints, we must [use good nodes / identify the true nodes]. A node is [good insofar as / true if] its causes and effects are modular, or we can losslessly compress phenomena related to it into effects on it and effects from it.
“The cost of compute” is an example of a great node (in the context of the future of AI): it’s affected by various things (choices made by Nvidia, innovation, etc.), and it affects various things (capability-level of systems made by OpenAI, relative importance of money vs talent at AI labs, etc.), and we lose nothing by thinking in terms of the cost of compute (relative to, e.g., the effects of the choices made by Nvidia on the capability-level of systems made by OpenAI).
“When Moore’s law will end” is an example of something that is not a node (in the context of the future of AI), since you’d be much better off thinking in terms of the underlying causes and effects.
The relations relevant to nodes are analytical not causal. For example, “the cost of compute” is a node between “evidence about historical progress” and “timelines,” not just between “stuff Nvidia does” and “stuff OpenAI does.” (You could also make a causal model, but here I’m interested in analytical models.)
Object level. I’m not sure how good “timelines,” “takeoff,” “polarity,” and “wakeup to capabilities” are as nodes. Most of the time it seems fine to talk about e.g. “effects on timelines” and “implications of timelines.” But maybe this conceals confusion.