This doesn’t work reliably enough. You need just one failure, and actually convincing (as opposed even to eliciting an ostensible admission of having been convinced) is really difficult. A serious complication is that it’s not possible to “make AGI Friendly”, most AGI designs can’t be fixed without essentially discarding everything, and so people won’t be moved deeply enough to kill their mind baby, they would instead raise up defenses against offending arguments, failing to understand the point and coming up with rationalizations that claim that whatever they are doing already happens to be Friendly (perhaps with minor modifications). Just look at Goertzel (see my comment).
Good point. Do you know if SIAI is planning on trying to build the first AGI? Isn’t the only other option to try to persuade others?
Also, I don’t really know too much about the specifics of AGI designs. Where could I learn more? Can you back up the claim that “most AGI designs can’t be fixed without essentially discarding everything”?
This doesn’t work reliably enough. You need just one failure, and actually convincing (as opposed even to eliciting an ostensible admission of having been convinced) is really difficult. A serious complication is that it’s not possible to “make AGI Friendly”, most AGI designs can’t be fixed without essentially discarding everything, and so people won’t be moved deeply enough to kill their mind baby, they would instead raise up defenses against offending arguments, failing to understand the point and coming up with rationalizations that claim that whatever they are doing already happens to be Friendly (perhaps with minor modifications). Just look at Goertzel (see my comment).
Good point. Do you know if SIAI is planning on trying to build the first AGI? Isn’t the only other option to try to persuade others?
Also, I don’t really know too much about the specifics of AGI designs. Where could I learn more? Can you back up the claim that “most AGI designs can’t be fixed without essentially discarding everything”?