If dust specks have a value of 0, then what’s the smallest amount of discomfort that has a nonzero value instead?
I don’t know exactly where I’d make the qualitative jump from the “discomfort” scale to the “pain” scale. There are so many different kinds of unpleasant stimuli, and it’s difficult to compare them. For electric shock, say, there’s probably a particular curve of voltage, amperage and duration below which the shock would qualify as discomfort, with a zero value on the pain scale, and above which it becomes pain (I’ll even go so far as to say that for short periods of contact, the voltage and amperage values lies between those of a violet wand and those of a stun gun). For localized heat, I think it would have to be at least enough to cause a small first-degree burn; for localized cold, enough to cause the beginnings of frostbite (i.e. a few living cells lysed by the formation of ice crystals in their cytoplasm). For heat and cold over the whole body, it would have to be enough to overcome the body’s natural thermostat, initiating hypothermia or heatstroke.
It occurs to me that I’ve purposefully endured levels of discomfort I would probably regard as pain with a non-zero value on the torture scale if it was inflicted on me involuntarily, as a result of working out at the gym (which has an expected payoff in health and appearance, of course), and from wearing an IV for two 36-hour periods in a pharmacokinetic study for which I’d volunteered (it paid $500); I would certainly do so again, for the same inducements. Choice makes a big difference in our subjective experience of an unpleasant stimulus.
50 years of torture for one person is probably not as bad as 25 years of torture for a trillion people.
Of course not; by the scale I posited above, 50 years for one person isn’t even as bad as 25 years for two people.
If we keep doing this (halving the torture length, multiplying the number of people by a trillion) then are we always going from bad to worse?
No, but the length has to get pretty tiny (probably somewhere between a millisecond and a microsecond) before we reverse the direction.
And do we ever get to the point where each individual person tortured experiences about as much discomfort as our replacement dust speck?
Yes, we do; in fact, we eventually get to a point where each person “tortured” experiences no discomfort at all, because the nervous system is not infinitely fast nor infinitely sensitive. If you’re using temperature for your torture, heat transfer happens at a finite speed; no matter how hot or cold the material that touches your skin, there’s a possible time of contact short enough that it wouldn’t change your skin temperature enough to cause any discomfort at all. Even an electric shock could be brief enough not to register.
The idea that the utility should be continuous is mathematically equivalent to the idea that an infinitesimal change on the discomfort/pain scale should give an infinitesimal change in utility. If you don’t use that axiom to derive your utility funciton, you can have sharp jumps at arbitrary pain thresholds. That’s perfectly OK—but then you have to choose where the jumps are.
I think that’s probably more practical than trying to make it continuous, considering that our nervous systems are incapable of perceiving infinitesimal changes.
Yes, we are running on corrupted hardware at about
100 Hz, and I agree that defining broad categories to make first-cut decisions is necessary.
But if we were designing a morality program for a super-intelligent AI, we would want to be as mathematically consistent as possible. As shminux implies, we can construct pathological situations that exploit the particular choice of discontinuities to yield unwanted or inconsistent results.
It could be worse than that: there might not be a way to choose the jumps consistently, say, to include different kinds of discomfort, some related to physical pain and others not (tickling? itching? anguish? ennui?)
I might have to bring it up to a minute or two before I’d give you that—I perceive the exponential growth in disutility for extreme pain over time during the first few minutes/hours/days as very, very steep. Now, if we posit that the people involved are immortal, that would change the equation quite a bit, because fifty years isn’t proportionally that much more than fifty seconds in a life that lasts for billions of years; but assuming the present human lifespan, fifty years is the bulk of a person’s life. What duration of torture qualifies as a literal fate worse than (immediate) death, for a human with a life expectancy of eighty years? I’ll posit that it’s more than five years and less than fifty, but beyond that I wouldn’t care to try to choose.
Let’s step away from outright torture and look at something different: solitary confinement. How long does a person have to be locked in a room against his or her will before it rises to a level that would have a non-zero disutility you could multiply by 3^^^3 to get a higher disutility than that of a single person (with a typical, present-day human lifespan) locked up that way for fifty years? I’m thinking, off the top of my head, that non-zero disutility on that scale would arise somewhere between 12 and 24 hours.
If dust specks have a value of 0, then what’s the smallest amount of discomfort that has a nonzero value instead?
I don’t know exactly where I’d make the qualitative jump from the “discomfort” scale to the “pain” scale. There are so many different kinds of unpleasant stimuli, and it’s difficult to compare them. For electric shock, say, there’s probably a particular curve of voltage, amperage and duration below which the shock would qualify as discomfort, with a zero value on the pain scale, and above which it becomes pain (I’ll even go so far as to say that for short periods of contact, the voltage and amperage values lies between those of a violet wand and those of a stun gun). For localized heat, I think it would have to be at least enough to cause a small first-degree burn; for localized cold, enough to cause the beginnings of frostbite (i.e. a few living cells lysed by the formation of ice crystals in their cytoplasm). For heat and cold over the whole body, it would have to be enough to overcome the body’s natural thermostat, initiating hypothermia or heatstroke.
It occurs to me that I’ve purposefully endured levels of discomfort I would probably regard as pain with a non-zero value on the torture scale if it was inflicted on me involuntarily, as a result of working out at the gym (which has an expected payoff in health and appearance, of course), and from wearing an IV for two 36-hour periods in a pharmacokinetic study for which I’d volunteered (it paid $500); I would certainly do so again, for the same inducements. Choice makes a big difference in our subjective experience of an unpleasant stimulus.
50 years of torture for one person is probably not as bad as 25 years of torture for a trillion people.
Of course not; by the scale I posited above, 50 years for one person isn’t even as bad as 25 years for two people.
If we keep doing this (halving the torture length, multiplying the number of people by a trillion) then are we always going from bad to worse?
No, but the length has to get pretty tiny (probably somewhere between a millisecond and a microsecond) before we reverse the direction.
And do we ever get to the point where each individual person tortured experiences about as much discomfort as our replacement dust speck?
Yes, we do; in fact, we eventually get to a point where each person “tortured” experiences no discomfort at all, because the nervous system is not infinitely fast nor infinitely sensitive. If you’re using temperature for your torture, heat transfer happens at a finite speed; no matter how hot or cold the material that touches your skin, there’s a possible time of contact short enough that it wouldn’t change your skin temperature enough to cause any discomfort at all. Even an electric shock could be brief enough not to register.
The idea that the utility should be continuous is mathematically equivalent to the idea that an infinitesimal change on the discomfort/pain scale should give an infinitesimal change in utility. If you don’t use that axiom to derive your utility funciton, you can have sharp jumps at arbitrary pain thresholds. That’s perfectly OK—but then you have to choose where the jumps are.
I think that’s probably more practical than trying to make it continuous, considering that our nervous systems are incapable of perceiving infinitesimal changes.
Yes, we are running on corrupted hardware at about 100 Hz, and I agree that defining broad categories to make first-cut decisions is necessary.
But if we were designing a morality program for a super-intelligent AI, we would want to be as mathematically consistent as possible. As shminux implies, we can construct pathological situations that exploit the particular choice of discontinuities to yield unwanted or inconsistent results.
It could be worse than that: there might not be a way to choose the jumps consistently, say, to include different kinds of discomfort, some related to physical pain and others not (tickling? itching? anguish? ennui?)
In other words, it follows that 1 person being tortured for 50 years is better than 3^^^3 people being tortured for a millisecond.
You’re well on your way to the dark side.
I might have to bring it up to a minute or two before I’d give you that—I perceive the exponential growth in disutility for extreme pain over time during the first few minutes/hours/days as very, very steep. Now, if we posit that the people involved are immortal, that would change the equation quite a bit, because fifty years isn’t proportionally that much more than fifty seconds in a life that lasts for billions of years; but assuming the present human lifespan, fifty years is the bulk of a person’s life. What duration of torture qualifies as a literal fate worse than (immediate) death, for a human with a life expectancy of eighty years? I’ll posit that it’s more than five years and less than fifty, but beyond that I wouldn’t care to try to choose.
Let’s step away from outright torture and look at something different: solitary confinement. How long does a person have to be locked in a room against his or her will before it rises to a level that would have a non-zero disutility you could multiply by 3^^^3 to get a higher disutility than that of a single person (with a typical, present-day human lifespan) locked up that way for fifty years? I’m thinking, off the top of my head, that non-zero disutility on that scale would arise somewhere between 12 and 24 hours.