It is possible that this would have been better overall.
Even if we reject 1, humanity was no where near extinction for thousands of years now.
You can easily augment the underlying harm avoidance principle with a condition that it should not result in the extinction of intelligent life (assuming that intelligent life doesn’t cause even more harm in the long run).
It’s a hypothetical—there is no evidence for or against it as it never happened and is highly unlikely to happen.
AI’s never been developed before either, but that hasn’t stopped people from trying to forecast the future, or at least enumerate likely scenarios. You were making a claim about a causal link: “following HedonicTreader’s guideline will cause humanity to go extinct.” Either this link exists or it does not, and you don’t get to back out of providing evidence just because the situation is a hypothetical.
But let me point out that it sets up a downward feedback loop.
What’s the loop?
(EDIT: Upon reflection, I feel I should clarify that I’m not actually disagreeing with you here. I’m slightly more sympathetic to HedonicTreader’s position than yours at the moment, but with some convincing, that could easily change. My questions should be interpreted more as requests for information than as rhetorical challenges.)
you don’t get to back out of providing evidence just because the situation is a hypothetical.
I use the word “evidence” to mean empirical evidence, that is, evidence from reality. Such does not exist in this case. Arguments from analogy, logic, etc. are not evidence.
What’s the loop?
The worsening of conditions triggers a major contraction of population which worsens the conditions further (contemporary economies take contraction badly and at sufficiently low population numbers and densities advanced technology becomes problematic) which triggers further contraction of the population...
His ethical guideline has nothing to do with how close humanity is to extinction.
Except I already wrote:
You can easily augment the underlying harm avoidance principle with a condition that it should not result in the extinction of intelligent life (assuming that intelligent life doesn’t cause even more harm in the long run).
You don’t even have to apply the principle of charity, you could just look at what I had literally written.
However, if practiced diligently, it can bring humanity to extinction in a few generations from any population size.
Nonsense. Most humans don’t live in a warzone at any time now. And followed in extreme poverty, this principle would reduce local malthusian traps and probably reduce poverty; at least the suffering of children from poverty.
Applying this, humanity would have quietly died out a few thousand years ago...
2 responses:
It is possible that this would have been better overall.
Even if we reject 1, humanity was no where near extinction for thousands of years now.
You can easily augment the underlying harm avoidance principle with a condition that it should not result in the extinction of intelligent life (assuming that intelligent life doesn’t cause even more harm in the long run).
That makes no sense to me at all.
Because it did not follow the ethical guideline that you suggested.
This statement, if true, only shows that not following the guideline back then was the correct choice. What about today?
What, do you feel, is the relevant difference between back then and today?
It’s as HedonicTreader said: humanity is nowhere near extinction today.
His ethical guideline has nothing to do with how close humanity is to extinction.
However, if practiced diligently, it can bring humanity to extinction in a few generations from any population size.
This is a questionable claim. Do you have any evidence to support it?
It’s a hypothetical—there is no evidence for or against it as it never happened and is highly unlikely to happen.
But let me point out that it sets up a downward feedback loop.
AI’s never been developed before either, but that hasn’t stopped people from trying to forecast the future, or at least enumerate likely scenarios. You were making a claim about a causal link: “following HedonicTreader’s guideline will cause humanity to go extinct.” Either this link exists or it does not, and you don’t get to back out of providing evidence just because the situation is a hypothetical.
What’s the loop?
(EDIT: Upon reflection, I feel I should clarify that I’m not actually disagreeing with you here. I’m slightly more sympathetic to HedonicTreader’s position than yours at the moment, but with some convincing, that could easily change. My questions should be interpreted more as requests for information than as rhetorical challenges.)
I use the word “evidence” to mean empirical evidence, that is, evidence from reality. Such does not exist in this case. Arguments from analogy, logic, etc. are not evidence.
The worsening of conditions triggers a major contraction of population which worsens the conditions further (contemporary economies take contraction badly and at sufficiently low population numbers and densities advanced technology becomes problematic) which triggers further contraction of the population...
Except I already wrote:
You don’t even have to apply the principle of charity, you could just look at what I had literally written.
Nonsense. Most humans don’t live in a warzone at any time now. And followed in extreme poverty, this principle would reduce local malthusian traps and probably reduce poverty; at least the suffering of children from poverty.