Why are these odd moments correlated with human action? I modify the memory at time 100, changing a memory of what happened at time 10. AIXI observes something happen at time 10, and then a memory modification at time 100. Perhaps AIXI can learn a mapping between memory locations and instants in time, but it can’t model a change which reaches backwards in time (unless it learns a model in which the entire history of the universe is determined in advance, and just revealed sequentially, in which case it has learned a good enough self-model to stop caring about its own decisions).
I was suggesting that that if the time difference wasn’t too large, the AIXI could deduce “humans plan at time 10 to press button” → “weirdness at time 10 and button pressed at time 100″. If it’s good a modelling us, it may be able to deduce our plans long before we do, and as long as the plan predates the weirdness, it can model the plan as causal.
Or if it experiences more varied situations, it might deduce “no interactions with humans for long periods” → “no weirdness”, and act in consequence.
Why are these odd moments correlated with human action? I modify the memory at time 100, changing a memory of what happened at time 10. AIXI observes something happen at time 10, and then a memory modification at time 100. Perhaps AIXI can learn a mapping between memory locations and instants in time, but it can’t model a change which reaches backwards in time (unless it learns a model in which the entire history of the universe is determined in advance, and just revealed sequentially, in which case it has learned a good enough self-model to stop caring about its own decisions).
I was suggesting that that if the time difference wasn’t too large, the AIXI could deduce “humans plan at time 10 to press button” → “weirdness at time 10 and button pressed at time 100″. If it’s good a modelling us, it may be able to deduce our plans long before we do, and as long as the plan predates the weirdness, it can model the plan as causal.
Or if it experiences more varied situations, it might deduce “no interactions with humans for long periods” → “no weirdness”, and act in consequence.