Re Embedded Agency problems, my hope is that the successors to the physically universal computer/cellular automaton literatures has at least the correct framework to answer a lot of the questions asked, because they force some of the consequences of embeddedness there, especially the fact that under physical universality, you can’t have the machine be special, and in particular you’re not allowed to use the abstraction in which there are clear divisions between machine states and data states, with the former operating on the latter.
Re Embedded Agency problems, my hope is that the successors to the physically universal computer/cellular automaton literatures has at least the correct framework to answer a lot of the questions asked, because they force some of the consequences of embeddedness there, especially the fact that under physical universality, you can’t have the machine be special, and in particular you’re not allowed to use the abstraction in which there are clear divisions between machine states and data states, with the former operating on the latter.