That’s a really interesting reference to lamprey decision-making, thanks!
The descriptions and even the terminological choices are very similar to that in the hierarchical reinforcement learning literature, for example Sutton, Precup and Singh 1999. They use ‘option’ to refer to a kind of sub-policy which sequentially composes atomic/primitive actions, and can be activated or deactivated by higher-level controllers, and learned or improved through reinforcement—I assume Quintin and/or Alex invoke this or similar by use of the same term.
That’s a really interesting reference to lamprey decision-making, thanks!
The descriptions and even the terminological choices are very similar to that in the hierarchical reinforcement learning literature, for example Sutton, Precup and Singh 1999. They use ‘option’ to refer to a kind of sub-policy which sequentially composes atomic/primitive actions, and can be activated or deactivated by higher-level controllers, and learned or improved through reinforcement—I assume Quintin and/or Alex invoke this or similar by use of the same term.