If the agent in question has a well-defined utility function, why is he deferring to the FAI to explain it to him?
Because he is bad at introspection and his only access to the utility function is through a noisy low-bandwidth sensor called “intuition”.
If the agent in question has a well-defined utility function, why is he deferring to the FAI to explain it to him?
Because he is bad at introspection and his only access to the utility function is through a noisy low-bandwidth sensor called “intuition”.