To talk about “stable under self-modification”, you need a notion of what it is that needs to be stable, the kind of data that specifies a decision problem. Once we have that notion, it could turn out to be relatively straightforward to extract its instance from human minds (but probably not). On the other hand, while we don’t have that notion, there is little point in attacking the human decision problem extraction problem.
To talk about “stable under self-modification”, you need a notion of what it is that needs to be stable, the kind of data that specifies a decision problem. Once we have that notion, it could turn out to be relatively straightforward to extract its instance from human minds (but probably not). On the other hand, while we don’t have that notion, there is little point in attacking the human decision problem extraction problem.