I am in the final implementation stages of the general intelligence algorithm.
Do you mean “I am in the final writing stages of a paper on a general intelligence algorithm?” If you were in the final implementation stages of what LW would recognize as the general intelligence algorithm, the very last thing you would want to do is mention that fact here; and the second-to-last thing you’d do would be to worry about personal credit.
I am open to arguments as to why that might be the case, but unless you also have the GIA, I should be telling you what things I would want to do first and last. I don’t really see what the risk is, since I haven’t given anyone any unique knowledge that would allow them to follow in my footsteps.
A paper? I’ll write that in a few minutes after I finish the implementation. Problem statement → pseudocode → implementation. I am just putting some finishing touches on the data structure cases I created to solve the problem.
As far as I understand, the SIAI folks believe that the risk is, “you push the Enter key, your algorithm goes online, bootstraps itself to transhuman superintelligence, and eats the Earth with nanotechnology” (nanotech is just one possibility among many, of course). I personally don’t believe we’re in any danger of that happening any time soon, but these guys do. They have made it their mission in life to prevent this scenario from happening. Their mission and yours appear to be in conflict.
That is just wrong. SAI doesn’t really work like that. Those people have seen too many sci fi movies. It’s easy to psychologically manipulate an AI if you are smart enough to create one in the first place. To use terms I have seen tossed around, there is no difference between tool and agent AI. The agent only does things that you program it to do. It would take a malevolent genius to program something akin to a serial killer to cause that kind of scenario.
Retraction means that you no longer endorse the contents of a comment. The comment is not deleted so that it will not break existing conversations. Retracted comments are no longer eligible for voting. Once a comment is retracted, it can be revisited at which point there is a ‘delete’ option, which removes the comment permanently.
Do you mean “I am in the final writing stages of a paper on a general intelligence algorithm?” If you were in the final implementation stages of what LW would recognize as the general intelligence algorithm, the very last thing you would want to do is mention that fact here; and the second-to-last thing you’d do would be to worry about personal credit.
I am open to arguments as to why that might be the case, but unless you also have the GIA, I should be telling you what things I would want to do first and last. I don’t really see what the risk is, since I haven’t given anyone any unique knowledge that would allow them to follow in my footsteps.
A paper? I’ll write that in a few minutes after I finish the implementation. Problem statement → pseudocode → implementation. I am just putting some finishing touches on the data structure cases I created to solve the problem.
As far as I understand, the SIAI folks believe that the risk is, “you push the Enter key, your algorithm goes online, bootstraps itself to transhuman superintelligence, and eats the Earth with nanotechnology” (nanotech is just one possibility among many, of course). I personally don’t believe we’re in any danger of that happening any time soon, but these guys do. They have made it their mission in life to prevent this scenario from happening. Their mission and yours appear to be in conflict.
That is just wrong. SAI doesn’t really work like that. Those people have seen too many sci fi movies. It’s easy to psychologically manipulate an AI if you are smart enough to create one in the first place. To use terms I have seen tossed around, there is no difference between tool and agent AI. The agent only does things that you program it to do. It would take a malevolent genius to program something akin to a serial killer to cause that kind of scenario.
People who created Deep Thought have no problem beating it at chess.
What on earth is this retraction nonsense?
Retraction means that you no longer endorse the contents of a comment. The comment is not deleted so that it will not break existing conversations. Retracted comments are no longer eligible for voting. Once a comment is retracted, it can be revisited at which point there is a ‘delete’ option, which removes the comment permanently.
I didn’t realize that I was receiving all that mail...
Yummy 11 more tears