Minicamp made me take the notion of an Ugh Field seriously, and I’ve found Ugh Fields a fairly useful model for understanding how my brain works. I have/had lots of topics that have been unpleasant to think about and the cause of that unpleasantness seems to be strongly correlated with previous negative experiences.
More generally, animals, including humans, seem to use something like Temporal Difference learning very frequently (one source of that impression). If that’s so, then understanding TD and related psychological research should give me a more accurate model of myself. I would expect it to help me understand when my dispositions and habits are likely to be useful (by knowing how they developed) and understand how to change my dispositions and habits. Thus I have a couple of questions:
Are my impressions accurate?
What books, papers, posts are the best for understanding these topics? I’d like material that addresses any of the following:
How TD or related algorithms work
What evidence says about whether human and/or animal brains frequently use TD or related algorithms and what situations brains use it for
Practical consequences of the research (e.g. Ugh Fields, doing X is a good way to build habit Y, smiling is a reinforcement, etc.)
psychology and applications of reinforcement learning: where do I learn more?
Minicamp made me take the notion of an Ugh Field seriously, and I’ve found Ugh Fields a fairly useful model for understanding how my brain works. I have/had lots of topics that have been unpleasant to think about and the cause of that unpleasantness seems to be strongly correlated with previous negative experiences.
More generally, animals, including humans, seem to use something like Temporal Difference learning very frequently (one source of that impression). If that’s so, then understanding TD and related psychological research should give me a more accurate model of myself. I would expect it to help me understand when my dispositions and habits are likely to be useful (by knowing how they developed) and understand how to change my dispositions and habits. Thus I have a couple of questions:
Are my impressions accurate?
What books, papers, posts are the best for understanding these topics? I’d like material that addresses any of the following:
How TD or related algorithms work
What evidence says about whether human and/or animal brains frequently use TD or related algorithms and what situations brains use it for
Practical consequences of the research (e.g. Ugh Fields, doing X is a good way to build habit Y, smiling is a reinforcement, etc.)