That interestingly suggests the ASI might be more likely to spare us the more powerful it is. Perhaps trying to box it (or more generally curtail its capabilities/influence) really is a bad move after all?
Possibly, but I think that’s the wrong lesson. After all, there’s at least a tiny chance we succeed at boxing! Don’t put too much stake in “Pascal’s mugging”-style reasoning, and don’t try to play 4-dimensional chess as a mere mortal :)
That interestingly suggests the ASI might be more likely to spare us the more powerful it is. Perhaps trying to box it (or more generally curtail its capabilities/influence) really is a bad move after all?
Possibly, but I think that’s the wrong lesson. After all, there’s at least a tiny chance we succeed at boxing! Don’t put too much stake in “Pascal’s mugging”-style reasoning, and don’t try to play 4-dimensional chess as a mere mortal :)