What I mean is that when I think about inner alignment issues, I actually think of learned goal-directed models instead of learned inner optimizers. In that context, the former includes the latter. But I also expect that relatively powerful goal-directed systems can exist without a powerful simple structure like inner optimization, and that we should also worry about those.
That’s one way in which I expect deconfusing goal-directedness to help here: by replacing a weirdly-defined subset of the models we should worry about by what I expect to be the full set of worrying models in that context, with a hopefully clean definition.
Ah, on this point, I very much agree.
I’m not sure why piling on more data wouldn’t make the reliance on memory more difficult (so something like O(X^2) ?), but I don’t think it’s that important.
I was treating the brain as fixed in size, so, having some upper bound on memory. Naturally this isn’t quite true in practice (for all we know, healthy million-year-olds might have measurably larger heads if they existed, due to slow brain growth, but either way this seems like a technicality).
Ah, on this point, I very much agree.
I was treating the brain as fixed in size, so, having some upper bound on memory. Naturally this isn’t quite true in practice (for all we know, healthy million-year-olds might have measurably larger heads if they existed, due to slow brain growth, but either way this seems like a technicality).