I had in mind Chalmer’s definition: “Let us say that AI++ (or superintelligence) is AI of far greater than human level (say, at least as far beyond the most intelligent human as the most intelligent human is beyond a mouse)”
Is this in fact a definition? Is there a meaningful way we can comparatively measure the intelligence of both a human and a mouse? I don’t know of any way we can compare that doesn’t assume that humans are smarter. (Cortical folding, brain vs. body mass.)
In fact, is there a definition of the kind of superintelligence discussed here at length at all? We can do this through information-theory, and define intelligence with regards to optimization power, but how does one relate such definitions to the supposed capabilities of super-intelligences discussed here?
Is this in fact a definition? Is there a meaningful way we can comparatively measure the intelligence of both a human and a mouse? I don’t know of any way we can compare that doesn’t assume that humans are smarter. (Cortical folding, brain vs. body mass.)
In fact, is there a definition of the kind of superintelligence discussed here at length at all? We can do this through information-theory, and define intelligence with regards to optimization power, but how does one relate such definitions to the supposed capabilities of super-intelligences discussed here?