If we are not going to include problems with counterfitting utility as being part of The Wirehead Problem, then I propose the term The Pornography Problem be used to refer to them.
I think umbrella category which incldues both types of problem is the main one, though. Unless a better term can be found, The Wirehead Problem seems pretty appropriate as an umbrella term. Counterfitting utility is very close to direct self-stimulation.
The classical proposed way of dealing with this is to make sure the agent has some knowledge and understanding of what its goals actually are. What the best way of doing that is is an open problem.
If we are not going to include problems with counterfitting utility as being part of The Wirehead Problem, then I propose the term The Pornography Problem be used to refer to them.
I think umbrella category which incldues both types of problem is the main one, though. Unless a better term can be found, The Wirehead Problem seems pretty appropriate as an umbrella term. Counterfitting utility is very close to direct self-stimulation.
The classical proposed way of dealing with this is to make sure the agent has some knowledge and understanding of what its goals actually are. What the best way of doing that is is an open problem.