Speaking for myself, I do my best to include this worry in my methodology for improving my decisionmaking.
When I notice things I instinctively want, or things many others seem to want, which differ from my reflective purposes, I spend some effort trying to figure out why. Many times, I’m convinced that the instinctive A and D are just optimized for a different environment and set of goals than I currently expect to have. Other times, I do in fact notice that there are benefits to the instinctive or default reaction, and I incorporate that into my improved A and D.
All of these corrections are faulty and have failure modes related to incompleteness (esp. loss over time) and incorrectness (over- or under-correction based on incomplete knowledge or wrong calculation/heuristic). But they do happen.
I think my main disagreement is with Unfortunately they have no way of changing their D. I don’t think A and D are anywhere near as separate as you seem to. They seem deeply correlated to me, to the point that there may be no real distinction between them. And even if there is a distinction, similar mechanisms of change (study, planning, practice) are available to both.
Speaking for myself, I do my best to include this worry in my methodology for improving my decisionmaking.
When I notice things I instinctively want, or things many others seem to want, which differ from my reflective purposes, I spend some effort trying to figure out why. Many times, I’m convinced that the instinctive A and D are just optimized for a different environment and set of goals than I currently expect to have. Other times, I do in fact notice that there are benefits to the instinctive or default reaction, and I incorporate that into my improved A and D.
All of these corrections are faulty and have failure modes related to incompleteness (esp. loss over time) and incorrectness (over- or under-correction based on incomplete knowledge or wrong calculation/heuristic). But they do happen.
I think my main disagreement is with Unfortunately they have no way of changing their D. I don’t think A and D are anywhere near as separate as you seem to. They seem deeply correlated to me, to the point that there may be no real distinction between them. And even if there is a distinction, similar mechanisms of change (study, planning, practice) are available to both.