I assume that specifying your utility function is difficult for the same reasons that specifying the precise behaviour of any other aspect of your brain is difficult.
If you’re talking about a conscious, explicitly evaluated utility function then I doubt even most rationalists have such a thing.
To be able to say what a utility function is, you have to be conscious of it. It has to be evaluated—or else it isn’t your utility function. However, I am not sure that I know what you mean by “explicitly evaluated”.
In many cases, behaviour is produced unconsciously. The idea is more that a utility function should be consistent with most goal-oriented behaviour. If you claim that your goal in life is to convert people to Christianity, then you should show signs of actually trying to do that, as best you are able.
I assume that specifying your utility function is difficult for the same reasons that specifying the precise behaviour of any other aspect of your brain is difficult.
If you’re talking about a conscious, explicitly evaluated utility function then I doubt even most rationalists have such a thing.
I wasn’t expecting the ten significant figures.
To be able to say what a utility function is, you have to be conscious of it. It has to be evaluated—or else it isn’t your utility function. However, I am not sure that I know what you mean by “explicitly evaluated”.
In many cases, behaviour is produced unconsciously. The idea is more that a utility function should be consistent with most goal-oriented behaviour. If you claim that your goal in life is to convert people to Christianity, then you should show signs of actually trying to do that, as best you are able.