Under this view, perhaps a certain set of interpretability techniques might emerge under a paradigm that makes certain assumptions (eg, that ML kernals are “mostly” linear, that systems are “mostly” stateless, that exotic hacks of the underlying hardware aren’t in play, etc). If a series of anomalies were to accumulate that couldn’t be explained within this matrix, you might expect to see a new paradigm needed.
Under this view, perhaps a certain set of interpretability techniques might emerge under a paradigm that makes certain assumptions (eg, that ML kernals are “mostly” linear, that systems are “mostly” stateless, that exotic hacks of the underlying hardware aren’t in play, etc). If a series of anomalies were to accumulate that couldn’t be explained within this matrix, you might expect to see a new paradigm needed.