With the examples of discovery and creativity, I think it’s obvious that they increase happiness by a lot.
The point is that’s not sufficient. Like saying “all good is complexity, because for example a mother’s love for her child is really complex”. Yes, it’s complex compared to some boring things like carving identical chair legs out of wood over and over for eternity, but compared to, say, tiling the universe with the digits of chaitin’s omega or something, it’s nothing. And tiling the universe with chaitin’s omega would be a very boring and stupid thing to do.
You need to show that the value in question is the best way of generating happiness. Not just that it results in more than the status quo. It has to generate more happiness, than, say, putting everyone on heroine forever. Because otherwise someone who really cared about happiness would just do that.
I think a lot of our values do a very good job of increasing happiness, and I welcome an AI that can point out which values don’t.
And they other point is that values aren’t supposed to do a job. They’re meant to describe what job you would like done! If you care about something that doesn’t increase happiness, then self-modifying to lose that so as to make more happiness would be a mistake.
You need to show that the value in question is the best way of generating happiness.
You’re absolutely correct. Discovery may not always be the best way of generating happiness; and if it’s not, you should do something else.
And the other point is that values aren’t supposed to do a job.
Not all values are terminal values. Some people value coffee because it wakes them up; they don’t value coffee in itself. If they discover that coffee in fact doesn’t wake them up, they should stop valuing coffee.
With the examples of discovery and creativity, I think it’s obvious that they increase happiness by a lot.
The point is that’s not sufficient.
What is sufficient is demonstrating that if discovery does not promote happiness then it is not valuable. As I explained in my sorting sand example, discovery that does not in any way promote happiness is not worthwhile.
The point is that’s not sufficient. Like saying “all good is complexity, because for example a mother’s love for her child is really complex”. Yes, it’s complex compared to some boring things like carving identical chair legs out of wood over and over for eternity, but compared to, say, tiling the universe with the digits of chaitin’s omega or something, it’s nothing. And tiling the universe with chaitin’s omega would be a very boring and stupid thing to do.
You need to show that the value in question is the best way of generating happiness. Not just that it results in more than the status quo. It has to generate more happiness, than, say, putting everyone on heroine forever. Because otherwise someone who really cared about happiness would just do that.
And they other point is that values aren’t supposed to do a job. They’re meant to describe what job you would like done! If you care about something that doesn’t increase happiness, then self-modifying to lose that so as to make more happiness would be a mistake.
You’re absolutely correct. Discovery may not always be the best way of generating happiness; and if it’s not, you should do something else.
Not all values are terminal values. Some people value coffee because it wakes them up; they don’t value coffee in itself. If they discover that coffee in fact doesn’t wake them up, they should stop valuing coffee.
What is sufficient is demonstrating that if discovery does not promote happiness then it is not valuable. As I explained in my sorting sand example, discovery that does not in any way promote happiness is not worthwhile.