That seems like a reasonable paraphrase, at least if you include the qualification that the “quickly” is relative to the amount of structure that the inner layer has accumulated, so might not actually happen quickly enough to be useful in all cases.
For example, it seems plausible to me that the inner layer might come to optimize for its proxy estimations of outer reward more than for outer reward itself, and that those two things could become decoupled.
Sure, e.g. lots of exotic sexual fetishes look like that to me. Hmm, though actually that example makes me rethink the argument that you just paraphrased, given that those generally emerge early in an individual’s life and then generally don’t get “corrected”.
That seems like a reasonable paraphrase, at least if you include the qualification that the “quickly” is relative to the amount of structure that the inner layer has accumulated, so might not actually happen quickly enough to be useful in all cases.
Sure, e.g. lots of exotic sexual fetishes look like that to me. Hmm, though actually that example makes me rethink the argument that you just paraphrased, given that those generally emerge early in an individual’s life and then generally don’t get “corrected”.