Why am I so bullish on academic outreach? Why do I keep hammering on ‘getting the adults in the room’?
It’s not that I think academics are all Super Smart.
I think rationalists/alignment people correctly ascertain that most professors don’t have much useful to say about alignment & deep learning and often say silly things. They correctly see that much of AI congress is fueled by labs and scale not ML academia. I am bullish on non-ML academia, especially mathematics, physics and to a lesser extent theoretical CS, neuroscience, some parts of ML/ AI academia. This is because while I think 95 % of academia is bad and/or useless there are Pockets of Deep Expertise. Most questions in alignment are close to existing work in academia in some sense—but we have to make the connection!
A good example is ‘sparse coding’ and ‘compressed sensing’. Lots of mech.interp has been rediscovering some of the basic ideas of sparse coding. But there is vast expertise in academia about these topics. We should leverage these!
Other examples are singular learning theory, computational mechanics, etc
Pockets of Deep Expertise
Why am I so bullish on academic outreach? Why do I keep hammering on ‘getting the adults in the room’?
It’s not that I think academics are all Super Smart.
I think rationalists/alignment people correctly ascertain that most professors don’t have much useful to say about alignment & deep learning and often say silly things. They correctly see that much of AI congress is fueled by labs and scale not ML academia. I am bullish on non-ML academia, especially mathematics, physics and to a lesser extent theoretical CS, neuroscience, some parts of ML/ AI academia. This is because while I think 95 % of academia is bad and/or useless there are Pockets of Deep Expertise. Most questions in alignment are close to existing work in academia in some sense—but we have to make the connection!
A good example is ‘sparse coding’ and ‘compressed sensing’. Lots of mech.interp has been rediscovering some of the basic ideas of sparse coding. But there is vast expertise in academia about these topics. We should leverage these!
Other examples are singular learning theory, computational mechanics, etc