Paradigmatic surprises vary a lot in how dramatic they are. X-rays and double slit deserved WAY lower probabilities than 1%. I’m basically going on how convincing I find the arguments for uploading first and trying to maintain calibrated confidence intervals. I would not bet 99:1 against uploading happening first. I would bet 9:1 without qualm. I would probably bet 49:1 I find it very easy to tell personally credible stories (no outlandish steps) where uploading happens first for good reasons. The probability of any of those stories happening may be much less than 1%, but they probably constitute exemplars of a large class.
Assigning a 1% probability to uploading not happening in a given decade when it could happen, due to politics and/or revulsion, seems much too low. Decade-to-decade correlations could be pretty high but not plausibly near 1, so given civilization’s long term survival uploading is inevitable once the required tech is in place, but it’s silly to assume civilization’s long-term survival.
I don’t really think that outside views are that widely applicable a methodology and if there isn’t an obvious place to look for one there probably isn’t one. The buck for judgment and decision-making has to stop somewhere, and stopping with deciding on reference classes seems silly in most situations. That said, I share your concern. I’m sure that there is a bias in the community of interested people, but I think that the community’s most careful thinkers can and do largely avoid it. I certainly think bad outcomes are more likely than good ones, but I think that the odds are around 2:1 rather than 100:1.
I’d be interested in seeing your reasoning written out in a top-level post. 2:1 seems beyond optimistic to me, especially if you give AI before uploading 9:1, but I’m sure you have your reasons. Explaining a few of these ‘personally credible stories,’ and what classes you place them in such that they sum to 10% total may be helpful. This goes for why you think FAI has such a high chance or succeeding as well.
Also, I believe I used the phrase ‘outside view’ incorrectly, since I didn’t mean reference classes. I was interested to know if there are people who are not part of your community that help you with number crunching on the tech-side. An ‘unbiased’ source of probabilities, if you will.
I think of my community as essentially consisting of the people who are willing to do this sort of analysis, so almost axiomatically no.
The simplest reason for thinking that FAI is (relatively) likely to succeed is the same reason for thinking that slavery ending or world peace are more likely than one might assume from psychology or from economics, namely that people who think about them are unusually motivated to try to bring them about.
Paradigmatic surprises vary a lot in how dramatic they are. X-rays and double slit deserved WAY lower probabilities than 1%. I’m basically going on how convincing I find the arguments for uploading first and trying to maintain calibrated confidence intervals. I would not bet 99:1 against uploading happening first. I would bet 9:1 without qualm. I would probably bet 49:1 I find it very easy to tell personally credible stories (no outlandish steps) where uploading happens first for good reasons. The probability of any of those stories happening may be much less than 1%, but they probably constitute exemplars of a large class.
Assigning a 1% probability to uploading not happening in a given decade when it could happen, due to politics and/or revulsion, seems much too low. Decade-to-decade correlations could be pretty high but not plausibly near 1, so given civilization’s long term survival uploading is inevitable once the required tech is in place, but it’s silly to assume civilization’s long-term survival.
I don’t really think that outside views are that widely applicable a methodology and if there isn’t an obvious place to look for one there probably isn’t one. The buck for judgment and decision-making has to stop somewhere, and stopping with deciding on reference classes seems silly in most situations. That said, I share your concern. I’m sure that there is a bias in the community of interested people, but I think that the community’s most careful thinkers can and do largely avoid it. I certainly think bad outcomes are more likely than good ones, but I think that the odds are around 2:1 rather than 100:1.
I think that was probably the greatest single surprise in the entire history of time.
Outside of pure math at least. Irrational numbers were a big deal.
Measured in the prior probability that was assigned or could justly have been assigned beforehand, I don’t think irrational numbers come close.
I’d be interested in seeing your reasoning written out in a top-level post. 2:1 seems beyond optimistic to me, especially if you give AI before uploading 9:1, but I’m sure you have your reasons. Explaining a few of these ‘personally credible stories,’ and what classes you place them in such that they sum to 10% total may be helpful. This goes for why you think FAI has such a high chance or succeeding as well.
Also, I believe I used the phrase ‘outside view’ incorrectly, since I didn’t mean reference classes. I was interested to know if there are people who are not part of your community that help you with number crunching on the tech-side. An ‘unbiased’ source of probabilities, if you will.
I think of my community as essentially consisting of the people who are willing to do this sort of analysis, so almost axiomatically no.
The simplest reason for thinking that FAI is (relatively) likely to succeed is the same reason for thinking that slavery ending or world peace are more likely than one might assume from psychology or from economics, namely that people who think about them are unusually motivated to try to bring them about.