Thanks. Looks like I was using the word as I intended to.
My point is that humans (who are imperfect decision makers and not in full control of their motivational systems) may actually benefit from changing their terminal goals, even though perfectly rational agents with consistent utility functions never would want to.
Humans are not always consistent, and making yourself consistent can involve dropping or acquiring terminal goals. (Consider a converted slaveowner acquiring a terminal goal of improving quality of life for all humans.)
My original point stems from two observations: Firstly, that many people seem to have lost purposes where their terminal goals should be. Secondly, that some humans may find it difficult to “trick” their goal system.
You may find it easier to achieve “future me is a music star” by sending a version of yourself with different terminal goals (wanting to make music) into the future, as opposed to sending a version of you who makes music for fame’s sake. (The assumption here is that the music you make in the former case is better, and that you don’t have access to it in the latter case, because humans find it difficult to trick their goal system.)
This is somewhat related to purchasing warm fuzzies. There are some things you cannot achieve by willpower alone. In order to achieve your current terminal goals, you may need to change your terminal goals.
I realize that this is a potentially uncomfortable conclusion, but I reject wedrifid’s claim that I was misusing the word.
Thanks. Looks like I was using the word as I intended to.
My point is that humans (who are imperfect decision makers and not in full control of their motivational systems) may actually benefit from changing their terminal goals, even though perfectly rational agents with consistent utility functions never would want to.
Humans are not always consistent, and making yourself consistent can involve dropping or acquiring terminal goals. (Consider a converted slaveowner acquiring a terminal goal of improving quality of life for all humans.)
My original point stems from two observations: Firstly, that many people seem to have lost purposes where their terminal goals should be. Secondly, that some humans may find it difficult to “trick” their goal system.
You may find it easier to achieve “future me is a music star” by sending a version of yourself with different terminal goals (wanting to make music) into the future, as opposed to sending a version of you who makes music for fame’s sake. (The assumption here is that the music you make in the former case is better, and that you don’t have access to it in the latter case, because humans find it difficult to trick their goal system.)
This is somewhat related to purchasing warm fuzzies. There are some things you cannot achieve by willpower alone. In order to achieve your current terminal goals, you may need to change your terminal goals.
I realize that this is a potentially uncomfortable conclusion, but I reject wedrifid’s claim that I was misusing the word.