Underestimating the significance of superintelligence. People have a delusion that humanity is some theoretically optimum plateau of intelligence (due to brainwashing from Judeo-Christian theological ideas, which also permeate so-called “secular humanism”), which is the opposite of the truth. We’re actually among the stupidest possible species smart enough to launch a civilization.
This doesn’t seem to be a part of standard Christian or Jewish theology, so blaming that attitude on this seems misguided. His last sentence is also problematic- how does he know that with a sample size of one?
Michael:
Would you rather your AI be based on Hitler or Gandhi?
Seems to understate the case. Mindspace is large. The problem isn’t an AI that acts like Hitler. That’s not such a bad failure as things go. The worst case scenario more resembles Cthulhu than Hitler.
Anissimov correctly calls out Goertzel on his claim that he’s sure he could design a properly functioning nanny AI.
Goertzel does correctly point out that it seems likely that a nanny AI would take less understanding than a full Friendly AI with stable goals under self-modification.
This claim is rooted in some theoretical considerations that don’t obviously rely on directly sampling things.
In that case, can you expand on what those theoretical considerations are? As far as I can tell, the main thing that allows the launch of civilization is speech. But even people well below average intelligence can speak. Moreover, most of the major advances seem to be made not by the average individual but by the outliers. The idea that the species as a whole needs to be as intelligent as we are to make a civilization seems problematic. There may be issues here with what one means by civilization and how one is measuring intelligence.
Sure. If we had a tight, robust framework for how civilizations arise and what was required for them to arise, this would be a bad demand for particular proof. I’d be just as happy to see that. So it might have been better if my initial comment had been of the form “without any strong theoretical framework, this requires a sample size larger than 1”.
“This doesn’t seem to be a part of standard Christian or Jewish theology,”
~Actually even if there is no outright statement in the Bible, through the years, it is commonly accepted that human supremacy is stated in Genesis 1:26 - “Then God said, ‘Let us make mankind in our image’”. Man is created in God’s image—making him superior to all. Also in Gen. 3:22 - “The man has now become like one of us, knowing good and evil”. Man is like a God—the only difference is that they are not immortal.
Not necessarily my opinion, just what I believe the theology says, and what I have heard from theist friends that the theology says.
But both religions also have angels which are depicted often as in some ways superior to humans. (Incidentally, I suspect that Gen 1:26 was originally intended to be more literal, with a host of deities of roughly human-looking deities creating creatures that looked like themselves.)
I wasn’t talking about indivduals. Homo Erectus didn’t launch a civilisation. Nor did Homo habilis, Homo cepranensis, Homo antecessor, Homo heidelbergensis, Homo rhodesiensis, Homo neanderthalensis etc. That is relevant data.
I wasn’t talking about indivduals. Homo Erectus didn’t launch a civilisation. Nor did Homo habilis, Homo cepranensis, Homo antecessor, Homo heidelbergensis, Homo rhodesiensis, Homo neanderthalensis etc. That is relevant data.
H. neanderthalensis had complicated tools and weapons, including spears and axes and there’s evidence of tools used to stitch garments together. There’s some (controversial) evidence that neanderthals made musical instruments, and the presence of remains indicating severe wounds that have since healed suggests that they cared for their wounded. So how much civilization is necessary for something to be considered civilization?
(Note that there are two problems with my example of neanderthals- First, they had average brain size that was as large or larger than Homo sapiens so they may have been as smart. Second, many neanderthals coexisted with populations of H. sapiens and so may have obtained tools by trade and imitation.)
So how much civilization is necessary for something to be considered civilization?
The process of things taking off. See:
Civilisation (or civilization) is a sometimes controversial term which has been used in several related ways. Primarily, the term has been used to refer to human cultures which are complex in terms of technology, science, and division of labour. Such civilisations are generally urbanized.
Civilisation (or civilization) is a sometimes controversial term which has been used in several related ways. Primarily, the term has been used to refer to human cultures which are complex in terms of technology, science, and division of labour. Such civilisations are generally urbanized.
It should not need to happen more than once—and there are no signs that it has done so.
This isn’t a really helpful definition for our purposes. How complex does technology and division of labor need to be? There’s division of labor in hunter-gatherer groups for example. I would agree that by almost all expansions of this definition neanderthals didn’t make it, and that H. sapiens is the only species to have done so that we are aware of.
I am, however, puzzled by your statement that civilization arose only once. Do the New World civilizations of the Incans, Mayans, and Aztecs not count? I would think that the separation of the Old and New World would then necessitate at least two independent occasions where civilization has arisen.
This doesn’t seem to be a part of standard Christian or Jewish theology, so blaming that attitude on this seems misguided. His last sentence is also problematic- how does he know that with a sample size of one?
Seems to understate the case. Mindspace is large. The problem isn’t an AI that acts like Hitler. That’s not such a bad failure as things go. The worst case scenario more resembles Cthulhu than Hitler.
Anissimov correctly calls out Goertzel on his claim that he’s sure he could design a properly functioning nanny AI.
Goertzel does correctly point out that it seems likely that a nanny AI would take less understanding than a full Friendly AI with stable goals under self-modification.
You are demanding particular proof. This claim is rooted in some theoretical considerations that don’t obviously rely on directly sampling things.
In that case, can you expand on what those theoretical considerations are? As far as I can tell, the main thing that allows the launch of civilization is speech. But even people well below average intelligence can speak. Moreover, most of the major advances seem to be made not by the average individual but by the outliers. The idea that the species as a whole needs to be as intelligent as we are to make a civilization seems problematic. There may be issues here with what one means by civilization and how one is measuring intelligence.
Yes. But whatever the disambiguation, appealing to lack of particular proof won’t help.
Sure. If we had a tight, robust framework for how civilizations arise and what was required for them to arise, this would be a bad demand for particular proof. I’d be just as happy to see that. So it might have been better if my initial comment had been of the form “without any strong theoretical framework, this requires a sample size larger than 1”.
“This doesn’t seem to be a part of standard Christian or Jewish theology,”
~Actually even if there is no outright statement in the Bible, through the years, it is commonly accepted that human supremacy is stated in Genesis 1:26 - “Then God said, ‘Let us make mankind in our image’”. Man is created in God’s image—making him superior to all. Also in Gen. 3:22 - “The man has now become like one of us, knowing good and evil”. Man is like a God—the only difference is that they are not immortal.
Not necessarily my opinion, just what I believe the theology says, and what I have heard from theist friends that the theology says.
But both religions also have angels which are depicted often as in some ways superior to humans. (Incidentally, I suspect that Gen 1:26 was originally intended to be more literal, with a host of deities of roughly human-looking deities creating creatures that looked like themselves.)
Though people may think of it as an optimum for non-supernatural beings.
Plenty of our ancestors failed to launch a civilisation. Correlated samples, but not really just one data point.
No. He seems to talk about the species, and not its members.
I wasn’t talking about indivduals. Homo Erectus didn’t launch a civilisation. Nor did Homo habilis, Homo cepranensis, Homo antecessor, Homo heidelbergensis, Homo rhodesiensis, Homo neanderthalensis etc. That is relevant data.
H. neanderthalensis had complicated tools and weapons, including spears and axes and there’s evidence of tools used to stitch garments together. There’s some (controversial) evidence that neanderthals made musical instruments, and the presence of remains indicating severe wounds that have since healed suggests that they cared for their wounded. So how much civilization is necessary for something to be considered civilization?
(Note that there are two problems with my example of neanderthals- First, they had average brain size that was as large or larger than Homo sapiens so they may have been as smart. Second, many neanderthals coexisted with populations of H. sapiens and so may have obtained tools by trade and imitation.)
The process of things taking off. See:
http://en.wikipedia.org/wiki/Civilization
It should not need to happen more than once—and there are no signs that it has done so.
This isn’t a really helpful definition for our purposes. How complex does technology and division of labor need to be? There’s division of labor in hunter-gatherer groups for example. I would agree that by almost all expansions of this definition neanderthals didn’t make it, and that H. sapiens is the only species to have done so that we are aware of.
I am, however, puzzled by your statement that civilization arose only once. Do the New World civilizations of the Incans, Mayans, and Aztecs not count? I would think that the separation of the Old and New World would then necessitate at least two independent occasions where civilization has arisen.
Civilization only arose in one species. It’s arisen many times within that species, just not in any other species.
That’s the point I was getting at...