I expect AI progress to come incrementally, BTW—I don’t expect the Foomination. And I expect it to come from Google or someone similar; a large group of really smart, really hard-working people.
I’d like to point out that it’s not either/or: it’s possible (likely?) that it will take decades of hard work and incremental progress by lots of really smart people to advance AI science to a point where an AI could FOOM.
I would say likely, conditional on eventual FOOM. The alternative means both a concentration of probability mass in the next ten years and that the relevant theory and tools are almost wholly complete.
I’d like to point out that it’s not either/or: it’s possible (likely?) that it will take decades of hard work and incremental progress by lots of really smart people to advance AI science to a point where an AI could FOOM.
I would say likely, conditional on eventual FOOM. The alternative means both a concentration of probability mass in the next ten years and that the relevant theory and tools are almost wholly complete.