As far as I understand, the SIAI folks believe that the risk is, “you push the Enter key, your algorithm goes online, bootstraps itself to transhuman superintelligence, and eats the Earth with nanotechnology” (nanotech is just one possibility among many, of course). I personally don’t believe we’re in any danger of that happening any time soon, but these guys do. They have made it their mission in life to prevent this scenario from happening. Their mission and yours appear to be in conflict.
That is just wrong. SAI doesn’t really work like that. Those people have seen too many sci fi movies. It’s easy to psychologically manipulate an AI if you are smart enough to create one in the first place. To use terms I have seen tossed around, there is no difference between tool and agent AI. The agent only does things that you program it to do. It would take a malevolent genius to program something akin to a serial killer to cause that kind of scenario.
Retraction means that you no longer endorse the contents of a comment. The comment is not deleted so that it will not break existing conversations. Retracted comments are no longer eligible for voting. Once a comment is retracted, it can be revisited at which point there is a ‘delete’ option, which removes the comment permanently.
As far as I understand, the SIAI folks believe that the risk is, “you push the Enter key, your algorithm goes online, bootstraps itself to transhuman superintelligence, and eats the Earth with nanotechnology” (nanotech is just one possibility among many, of course). I personally don’t believe we’re in any danger of that happening any time soon, but these guys do. They have made it their mission in life to prevent this scenario from happening. Their mission and yours appear to be in conflict.
That is just wrong. SAI doesn’t really work like that. Those people have seen too many sci fi movies. It’s easy to psychologically manipulate an AI if you are smart enough to create one in the first place. To use terms I have seen tossed around, there is no difference between tool and agent AI. The agent only does things that you program it to do. It would take a malevolent genius to program something akin to a serial killer to cause that kind of scenario.
People who created Deep Thought have no problem beating it at chess.
What on earth is this retraction nonsense?
Retraction means that you no longer endorse the contents of a comment. The comment is not deleted so that it will not break existing conversations. Retracted comments are no longer eligible for voting. Once a comment is retracted, it can be revisited at which point there is a ‘delete’ option, which removes the comment permanently.
I didn’t realize that I was receiving all that mail...
Yummy 11 more tears