I do think that’s a central unifying piece. Relevant pieces include What An Algorithm Feels Like From the Inside, and “Intelligence, Preferences and Morality have to come from somewhere, from non-mysterious things that are fundamentally not intelligence, preferences, morality, etc. You need some way to explain how this comes to be, and there are constraints on what sort of answer makes sense.”
I think much of the sequences are laying out different confusions people have about this and addressing them.
(retracted)
I do think that’s a central unifying piece. Relevant pieces include What An Algorithm Feels Like From the Inside, and “Intelligence, Preferences and Morality have to come from somewhere, from non-mysterious things that are fundamentally not intelligence, preferences, morality, etc. You need some way to explain how this comes to be, and there are constraints on what sort of answer makes sense.”
I think much of the sequences are laying out different confusions people have about this and addressing them.