My utility function corresponds to specific structures in my brain.
Do you mean there’s a particular structure in your brain sending out “good” and “bad” messages, and that’s what you’re trying to optimize? (i.e. that you would choose to wirehead).
Or do you mean in the sense that “utility functions have something to do with expressed and revealed preferences which necessarily correspond to structures in my brain?”
here have been many things in my life that I’ve thought about and decided weren’t that important
Could they be covered under the umbrella of “I value things which I would enjoy if I tried”?
Or do you mean in the sense that “utility functions have something to do with expressed and revealed preferences which necessarily correspond to structures in my brain?”
More the latter.
Could they be covered under the umbrella of “I value things which I would enjoy if I tried”?
Yes, but I don’t know how to optimize for those things (other than being generally adventurous/curious), since I don’t know if I would enjoy them.
Do you mean there’s a particular structure in your brain sending out “good” and “bad” messages, and that’s what you’re trying to optimize? (i.e. that you would choose to wirehead).
Or do you mean in the sense that “utility functions have something to do with expressed and revealed preferences which necessarily correspond to structures in my brain?”
Could they be covered under the umbrella of “I value things which I would enjoy if I tried”?
More the latter.
Yes, but I don’t know how to optimize for those things (other than being generally adventurous/curious), since I don’t know if I would enjoy them.