I wish I were confident enough in my skills, knowledge and rationality to actually work on some of these papers. “Self-Modification and Löb’s Theorem” is exactly what comes up when I query my brain for “awesome time spent in a cave dedicated entirely to solving X”. All the delicious mind-bending recursion.
Hopefully in a few years I’ll look back on this and chuckle. “Hah, to think that back then I thought of simple things like self-modification and Löb’s Theorem as challenges! How much stronger I’ve become, now.”
More on topic, I feel like there’s a need for something addressing the specific AGI vs Specialized AI questions/issues. Among things that pop to mind, why a self-modifying “specialized” AI will, given enough time and computing power, just end up becoming a broken paperclip-maximizing AGI anyway—even if it’s “grown” from weak Machine Learning algorithms.
I wish I were confident enough in my skills, knowledge and rationality to actually work on some of these papers. “Self-Modification and Löb’s Theorem” is exactly what comes up when I query my brain for “awesome time spent in a cave dedicated entirely to solving X”. All the delicious mind-bending recursion.
Hopefully in a few years I’ll look back on this and chuckle. “Hah, to think that back then I thought of simple things like self-modification and Löb’s Theorem as challenges! How much stronger I’ve become, now.”
More on topic, I feel like there’s a need for something addressing the specific AGI vs Specialized AI questions/issues. Among things that pop to mind, why a self-modifying “specialized” AI will, given enough time and computing power, just end up becoming a broken paperclip-maximizing AGI anyway—even if it’s “grown” from weak Machine Learning algorithms.