Cognitive neuroscience and cognitive psychology are far more relevant. A Friendly AI is a moral agent; it’s more like a judge than a cruise missile. A killer robot must inflict harm appropriately but it does not need to know what “harm” is; that’s for politicians, generals, and other strategists.
We have to extract the part of the human cognitive algorithm which, on reflection, encodes the essence of rational and moral judgment and action. That’s the sort of achievement which FAI will require.
Cognitive neuroscience and cognitive psychology are far more relevant. A Friendly AI is a moral agent; it’s more like a judge than a cruise missile. A killer robot must inflict harm appropriately but it does not need to know what “harm” is; that’s for politicians, generals, and other strategists.
We have to extract the part of the human cognitive algorithm which, on reflection, encodes the essence of rational and moral judgment and action. That’s the sort of achievement which FAI will require.