But even if there was just a single scenario with the off chance of human survival, then this would be enough to work towards by literally spending all your time and resources on it. Anything else can only be described as suicidal.
Well, sure, I see the logic in that. Unlike you, however, my probability that (even if I started preparing in earnest now) I would survive an AGI that has taken control of most human infrastructure and has the capacity to invent new technologies is so low that my best course of action (best out of a bad lot) is to put all my efforts into preventing the creation of the AGI.
I arrive at that low probability by asking myself what would I do (what subgoals I would pursue) if I assigned zero intrinsic value to human life and human preferences and I could invent powerful new technologies (and discover new scientific laws that no human knows about) and my ability to plan were truly superhuman. I.e., I put myself in the “shoes” of the AGI (and I reflected on that vantage point over many days).
In other words, by the time AGI research has progressed to the stage that things like my supply of food, water and electricity get disrupted by an AGI, it is almost certainly already too late for me on my models.
Well, sure, I see the logic in that. Unlike you, however, my probability that (even if I started preparing in earnest now) I would survive an AGI that has taken control of most human infrastructure and has the capacity to invent new technologies is so low that my best course of action (best out of a bad lot) is to put all my efforts into preventing the creation of the AGI.
I arrive at that low probability by asking myself what would I do (what subgoals I would pursue) if I assigned zero intrinsic value to human life and human preferences and I could invent powerful new technologies (and discover new scientific laws that no human knows about) and my ability to plan were truly superhuman. I.e., I put myself in the “shoes” of the AGI (and I reflected on that vantage point over many days).
In other words, by the time AGI research has progressed to the stage that things like my supply of food, water and electricity get disrupted by an AGI, it is almost certainly already too late for me on my models.