What should you do?
Figure out that I’m not a perfectly rational agent and go on with the deal for as long as I feel like it.
Bail out when I subjectively can’t stand any more of Hell or when I’m fed up with writing lots of numbers on an impossibly long roll of paper.
Of course, these aren’t answers that help in developing a decision theory for an AI …
Figure out that I’m not a perfectly rational agent and go on with the deal for as long as I feel like it.
Bail out when I subjectively can’t stand any more of Hell or when I’m fed up with writing lots of numbers on an impossibly long roll of paper.
Of course, these aren’t answers that help in developing a decision theory for an AI …