Sorry for deleting my comment, I didn’t think you’d answer it so quickly. For posterity, it said: “Is their research secret? Any pointers?”
Here’s the list of SIAI publications. Apart from Eliezer’s writings, there’s only one moderately interesting item on the list: Peter de Blanc’s “convergence of expected utility” (or divergence, rather). That’s… good, I guess? My point stands.
Yes. If anyone finds out why Marcello’s research is secret, they have to be killed and cryopreserved for interrogation after the singularity.
Now why do you even ask why should people be afraid of something going terribly wrong at SIAI? Keeping it secret in order to avoid signaling the moment where it becomes necessary to keep it secret? Hmm...
Marcello, Anna Salamon, Carl Shulman, Nick Tarleton, plus a few up-and-coming people I am not acquainted with.
I don’t do any work comparable to Eliezer’s.
Why don’t you? You are brilliant, and you understand the problem statement, you merely need to study the right things to get started.
I don’t do any original work comparable to Eliezer.
I don’t do anything comparable to Eliezer.
Is their research secret? Any pointers?
Marcello’s research is secret, but not that of the others.
Sorry for deleting my comment, I didn’t think you’d answer it so quickly. For posterity, it said: “Is their research secret? Any pointers?”
Here’s the list of SIAI publications. Apart from Eliezer’s writings, there’s only one moderately interesting item on the list: Peter de Blanc’s “convergence of expected utility” (or divergence, rather). That’s… good, I guess? My point stands.
Is it secret why it’s secret? I can’t imagine.
Yes. If anyone finds out why Marcello’s research is secret, they have to be killed and cryopreserved for interrogation after the singularity.
Now why do you even ask why should people be afraid of something going terribly wrong at SIAI? Keeping it secret in order to avoid signaling the moment where it becomes necessary to keep it secret? Hmm...