I do not agree, and this is coming from someone who has much lower P(doom) estimates and has serious issues with Yudkowsky’s epistemics.
The real issue I have the the nanotechnology plans and fast takeoff plans is that they require more assumptions than Yudkowsky realizes, and he has a problem of overweighting their probabilities compared to what we actually see today.
They’re not magical, just way overweighted on their probability mass, IMO.
I don’t see how we disagree here? Maybe it’s the use of the word magical? I don’t intend to use it in the sense “not allowed by the laws of physics”, I am happy to replace that by overweighted probability mass if you think that’s more accurate.
Maybe it’s the use of the word magical? I don’t intend to use it in the sense “not allowed by the laws of physics”
Yes, that was my issue. From my vantage point, the tone of the comment implied that Yudkowskian foom scenarios were downright impossible, which wasn’t the case.
That stated, it looks like we came to an agreement here, so thanks for talking.
I do not agree, and this is coming from someone who has much lower P(doom) estimates and has serious issues with Yudkowsky’s epistemics.
The real issue I have the the nanotechnology plans and fast takeoff plans is that they require more assumptions than Yudkowsky realizes, and he has a problem of overweighting their probabilities compared to what we actually see today.
They’re not magical, just way overweighted on their probability mass, IMO.
I don’t see how we disagree here? Maybe it’s the use of the word magical? I don’t intend to use it in the sense “not allowed by the laws of physics”, I am happy to replace that by overweighted probability mass if you think that’s more accurate.
Yes, that was my issue. From my vantage point, the tone of the comment implied that Yudkowskian foom scenarios were downright impossible, which wasn’t the case.
That stated, it looks like we came to an agreement here, so thanks for talking.