I’m sure that’s true. The difference is that all that extra intelligence is tied up in a fallible meatsack; an AI, by definition, would not be. That was the flaw in my analogy—comparing apples to apples was not appropriate. It would have been more apt to compare a trowel to a backhoe. We can’t easily parallelize among the excess intelligence in all those human brains. An AI (of the type I presume singulatarians predict) could know more information and process it more quickly than any human or group of humans, regardless of how intelligent those humans were. So, yes, I don’t doubt that there’s tons of wasted human intelligence, but I find that unrelated to the question of AI.
I’m working from the assumption that folks who want FAI expect it to calculate, discover, and reason things which humans alone wouldn’t be able to accomplish for hundreds or thousands of years, and which benefit humanity. If that’s not the case I’ll have to rethink this. :)
I agree FAI should certainly be able to outclass human scientists in the creation of scientific theories and new technologies. This in itself has great value (at the very least we could spend happy years trying to follow the proofs).
I think my issue is that I think it will be insanely difficult to produce an AI and I do not believe it will produce a utopian “singularity”—where people would actually be happy. The same could be said of the industrial revolution. Regardless, my original post is borked. I concede the point.
I’m sure that’s true. The difference is that all that extra intelligence is tied up in a fallible meatsack; an AI, by definition, would not be. That was the flaw in my analogy—comparing apples to apples was not appropriate. It would have been more apt to compare a trowel to a backhoe. We can’t easily parallelize among the excess intelligence in all those human brains. An AI (of the type I presume singulatarians predict) could know more information and process it more quickly than any human or group of humans, regardless of how intelligent those humans were. So, yes, I don’t doubt that there’s tons of wasted human intelligence, but I find that unrelated to the question of AI.
I’m working from the assumption that folks who want FAI expect it to calculate, discover, and reason things which humans alone wouldn’t be able to accomplish for hundreds or thousands of years, and which benefit humanity. If that’s not the case I’ll have to rethink this. :)
I agree FAI should certainly be able to outclass human scientists in the creation of scientific theories and new technologies. This in itself has great value (at the very least we could spend happy years trying to follow the proofs).
I think my issue is that I think it will be insanely difficult to produce an AI and I do not believe it will produce a utopian “singularity”—where people would actually be happy. The same could be said of the industrial revolution. Regardless, my original post is borked. I concede the point.