Interesting analogy. If we accept that utilities are additive, then there is presumably a number of sparrows worth killing for. (Of course, there may be a limit on all possible sparrows or sparrow utilities may be largely due to species preservation or something. As an ethics-based vegetarian, however, I can simply change it to “sparrows tortured.) I would be uncomfortable trying to put a number on it, what with the various sacred value conflicts involved, but I accept that a Friendly AI (even one Friendly only to me) would know and act on it.
Maslow’s Pyramid is not intended as some sort of alternative to utilitarianism, it’s a description of how we should prioritize the needs of humans. An imperfect one, of course, but better than nothing.
How sure? Based on what? What would persuade you otherwise?
They almost certainly are on the margin (think taylor series approx of utility function). Get to the point where you are talking about killing a significant fraction of the sparrow population, then there’s no reason to think so.
To be clear: are you claiming that utilities are not additive? That there is some level of Bad Things that two (a thousand, a billion …) times as much is not worse? I’ve seen the position advocated, but only by appealing to scope insensitivity.
Interesting analogy. If we accept that utilities are additive, then there is presumably a number of sparrows worth killing for. (Of course, there may be a limit on all possible sparrows or sparrow utilities may be largely due to species preservation or something. As an ethics-based vegetarian, however, I can simply change it to “sparrows tortured.) I would be uncomfortable trying to put a number on it, what with the various sacred value conflicts involved, but I accept that a Friendly AI (even one Friendly only to me) would know and act on it.
Maslow’s Pyramid is not intended as some sort of alternative to utilitarianism, it’s a description of how we should prioritize the needs of humans. An imperfect one, of course, but better than nothing.
How sure? Based on what? What would persuade you otherwise?
Why?
They almost certainly are on the margin (think taylor series approx of utility function). Get to the point where you are talking about killing a significant fraction of the sparrow population, then there’s no reason to think so.
True, but this doesn’t apply to MugaSofer’s claim that
To be clear: are you claiming that utilities are not additive? That there is some level of Bad Things that two (a thousand, a billion …) times as much is not worse? I’ve seen the position advocated, but only by appealing to scope insensitivity.