I’m really glad to see this. I can’t say I fully grasp your particular approach, but what you’ve written about model fragments has really resonated.
My intuition around value extrapolation is that if we extrapolate the topic itself it’ll eventually turn into creating fine models of nervous system dynamics. Will be curious to see how your work intersects and what it assumes about neuroscience, and also what sort of neuroscience progress you think might make your work easier.
Good luck!
I really enjoyed this piece and think it’s an important topic.
The question of how the brain implements priors, and how they can become maladaptively ‘trapped’, is an open question. I suggested last year that we could combine the “hemo-neural hypothesis” that bloodflow regulates the dynamic range of nearby neurons/nerves, with the “latch-bridge mechanism” where smooth muscle (inclusive of vascular muscle) can lock itself in a closed position. I.e. vascular tension is a prediction (Bayesian prior) about the world, and such patterns of microtension can be stored in a very durable form (“smooth muscle latches”) that can persist for days, weeks, months, years, decades.
This paints psychological release, releasing a trapped prior, and vasomuscular release as the same thing.
https://opentheory.net/2023/07/principles-of-vasocomputation-a-unification-of-buddhist-phenomenology-active-inference-and-physical-reflex-part-i/