What would it mean for an AGI to not have a utility function, specifically what do you mean by “incoherently”?
The key issue for humans is not whether humans have utility functions, but whether it’s useful to model humans as having utility functions.
What would it mean for an AGI to not have a utility function, specifically what do you mean by “incoherently”?
The key issue for humans is not whether humans have utility functions, but whether it’s useful to model humans as having utility functions.