A general rebuttal: Having a misunderstanding of the territory may cause you to formulate a goal that cannot be realized. However, a rational agent may well work to maximize his utility by approximating the resolution of the goal—decreasing the distance as much as possible between the territory and the goal-state. Not working towards the goal does not maximize utility.
A general rebuttal: Having a misunderstanding of the territory may cause you to formulate a goal that cannot be realized. However, a rational agent may well work to maximize his utility by approximating the resolution of the goal—decreasing the distance as much as possible between the territory and the goal-state. Not working towards the goal does not maximize utility.
Utility functions aren’t necessarily monotonic.