Some of these counterarguments seem rather poorly thought through.
For example, we have an argument from authority (AI Safety researchers have a consensus that AI Safety is important) which seems to suffer rather heavily from selection bias. He later undermines this argument by rejecting authority entirely in his response to “Majority of AI Researchers not Worried,” stating that “this objection is “irrelevant, even if 100% of mathematicians believed 2 + 2 = 5, it would still be wrong.” We have a Pascal’s Wager (“if even a tiniest probability is multiplied by the infinite value of the Universe”) with all the problems that comes with, along with the fact that heat death guarantees that the value of the Universe is not, in fact, infinite.
The author seem to be of the mindset that there are no coherent objects to AI Risk; i.e. that there is nothing which should shift our priors in the direction of skepticism, even if other concerns may override these updates. An honest reasoner in the presence of a complex problem with limited information will admit that some number of facts are indeed better explained by an alternate hypothesis, stressing instead that the weight of the evidence points towards the argued-for hypothesis.
Some of these counterarguments seem rather poorly thought through.
For example, we have an argument from authority (AI Safety researchers have a consensus that AI Safety is important) which seems to suffer rather heavily from selection bias. He later undermines this argument by rejecting authority entirely in his response to “Majority of AI Researchers not Worried,” stating that “this objection is “irrelevant, even if 100% of mathematicians believed 2 + 2 = 5, it would still be wrong.” We have a Pascal’s Wager (“if even a tiniest probability is multiplied by the infinite value of the Universe”) with all the problems that comes with, along with the fact that heat death guarantees that the value of the Universe is not, in fact, infinite.
The author seem to be of the mindset that there are no coherent objects to AI Risk; i.e. that there is nothing which should shift our priors in the direction of skepticism, even if other concerns may override these updates. An honest reasoner in the presence of a complex problem with limited information will admit that some number of facts are indeed better explained by an alternate hypothesis, stressing instead that the weight of the evidence points towards the argued-for hypothesis.