People who doubt the high-faluting research will save the world will not be convinced you’re doing effective work by teaching the basics (e.g. rationality books) or advertising for SIAI (e.g. Carl saying “We’re important”). If there are impressive hard-to-see results, the transparency work is valuable. But SIAI publications are already listed, and they don’t look all that awesome (for one thing, I can understand them).
We have three chapters forthcoming in The Singularity Hypothesis, one chapter forthcoming in The Cambridge Handbook of Artificial Intelligence, one forthcoming article on the difficulty of AI, and several other articles and working papers we’re planning to publish in 2012.
Looks like I do. (Uh, can I say that Peter is much smarter than I and that I will pick lice from his and your backs or whatever I need to do for this not to be a status grab?)
Ontological crises is about mappings between models of the world to define utility functions over new domains. It maps each state in the old ontology to a probability distribution over states in the new one, which I think is clever and cute. But most of the work to figure how mapping should actually be done (besides the “if it ain’t broke don’t fix it” rule about isomorphism, and continuity) will be in looking at humans, as the conclusion says.
Did I miss any papers?
Thanks for the abstracts! They seem to center mostly around defending various schools of Singularity predictions, especially the fourth one, plus yours which says “Value is fragile”.
People who doubt the high-faluting research will save the world will not be convinced you’re doing effective work by teaching the basics (e.g. rationality books) or advertising for SIAI (e.g. Carl saying “We’re important”). If there are impressive hard-to-see results, the transparency work is valuable. But SIAI publications are already listed, and they don’t look all that awesome (for one thing, I can understand them).
I look forward to these! Can has summaries?
Your outline of open problems is pretty good.
You understand De Blanc’s papers?
The Singularity Hypothesis abstracts are here.
Looks like I do. (Uh, can I say that Peter is much smarter than I and that I will pick lice from his and your backs or whatever I need to do for this not to be a status grab?)
Convergence of expected utility is a grown-up version of his post explaining the basic idea. Understanding details of the proof is work, but not hard.
Ontological crises is about mappings between models of the world to define utility functions over new domains. It maps each state in the old ontology to a probability distribution over states in the new one, which I think is clever and cute. But most of the work to figure how mapping should actually be done (besides the “if it ain’t broke don’t fix it” rule about isomorphism, and continuity) will be in looking at humans, as the conclusion says.
Did I miss any papers?
Thanks for the abstracts! They seem to center mostly around defending various schools of Singularity predictions, especially the fourth one, plus yours which says “Value is fragile”.