It looks like AIXI is already dynamically inconsistent, since it assumes that on step k+1, it will look m_k - (k+1) steps ahead, when it will in fact look m_(k+1) - (k+1) steps ahead. I suppose if the utility of a prefix of a string is a good heuristic for the utility of the whole string, this isn’t a huge problem?
This is a very interesting paper.
Reminds me of HIGHLANDER for some reason… those guys lived for thousands of years and weren’t even rich? They hadn’t usurped control of vast econo-political empires? No hundred-generations-long family of bodyguards?
I think people would get pretty antsy when it became clear that the guy running their town was an immortal. If I were a 13th century peasant with a hankering for revolt and a touch of the plague, I would do terrible, terrible things to someone who was both immortal and rich. Probably best not to get too showy.
This generalizes to the horizon problem: If at time k you only look ahead to time step m_k but have unlimited life span you will make infinitely large mistakes.
It looks like AIXI is already dynamically inconsistent, since it assumes that on step k+1, it will look m_k - (k+1) steps ahead, when it will in fact look m_(k+1) - (k+1) steps ahead. I suppose if the utility of a prefix of a string is a good heuristic for the utility of the whole string, this isn’t a huge problem?
AIXI actually has a configurable horizon function. It’s described on page 30 of AIXIgentle.
There is also a more detailed paper by Lattimore and Hutter (2011) on discounting and time consistency that is interesting in that context.
This is a very interesting paper. Reminds me of HIGHLANDER for some reason… those guys lived for thousands of years and weren’t even rich? They hadn’t usurped control of vast econo-political empires? No hundred-generations-long family of bodyguards?
I think people would get pretty antsy when it became clear that the guy running their town was an immortal. If I were a 13th century peasant with a hankering for revolt and a touch of the plague, I would do terrible, terrible things to someone who was both immortal and rich. Probably best not to get too showy.
If a human line of descent can’t do that, why should an immortal be able to do that?
Consistency? And, in fairness, human lines of descent have become monarchies, which worked out pretty well for a while.
This generalizes to the horizon problem: If at time k you only look ahead to time step m_k but have unlimited life span you will make infinitely large mistakes.