artificial selection is a subset of natural selection
Yes. The question is: why would we artificially select what’s harmful to us? Even though artificial selection is a subset of natural selection, it’s a different route to danger.
plenty of humans are just going to ask for the most destructive thing they can think of, because they can.
The most destructive thing you can think of will kill you too.
yeah, the people who would do it are not flustered by the idea that it’ll kill them. maximizing doomsday weapon strength just for the hell of it is in fact a thing some people try. unless we can defend against it, it’ll dominate—and it seems to me that current plans for how to defend against the key paths to superweaponhood are not yet plausible. we must end all vulnerabilities in biology and software. serious ideas for how to do that would be appreciated. otherwise, this is my last reply in this thread.
If everybody has some access to ASI, the crazy people do, and the sane people do as well. The good thing about ASI is that even active warfare need not be destructive...the white hats can hold off the black hats even during active warfare, because it’s all fought with bits.
A low power actor would need a physical means to kill everybody...like a supervirus. So those are the portals you need to close.
Yes. The question is: why would we artificially select what’s harmful to us? Even though artificial selection is a subset of natural selection, it’s a different route to danger.
The most destructive thing you can think of will kill you too.
yeah, the people who would do it are not flustered by the idea that it’ll kill them. maximizing doomsday weapon strength just for the hell of it is in fact a thing some people try. unless we can defend against it, it’ll dominate—and it seems to me that current plans for how to defend against the key paths to superweaponhood are not yet plausible. we must end all vulnerabilities in biology and software. serious ideas for how to do that would be appreciated. otherwise, this is my last reply in this thread.
If everybody has some access to ASI, the crazy people do, and the sane people do as well. The good thing about ASI is that even active warfare need not be destructive...the white hats can hold off the black hats even during active warfare, because it’s all fought with bits.
A low power actor would need a physical means to kill everybody...like a supervirus. So those are the portals you need to close.