We cannot be sure that there are difficulties beyond our comprehension but we are certainly able to assign probabilities to that hypothesis based on what we know. I would be justifiably shocked if something we could call a super-intelligence couldn’t be formed based on knowledge that is accessible to us, even if the process of putting the seed of a super-intelligence together is beyond us.
Humans aren’t even remotely optimised for generalised intelligence, it’s just a trick we picked up to, crudely speaking, get laid. There is no reason that a intelligence of the form “human thinking minus the parts that suck and a bit more of the parts that don’t suck” couldn’t be created using the knowledge available to us and that is something we can easily place a high probability on. Then you run the hardware at more than 60hz.
Oh, I agree. We just don’t know what self-modifications will be necessary to achieve non-speed-based optimizations.
To put it another way, if superintelligences are competing with each other and self-modifying in order to do so, predictions about the qualities those superintelligences will possess are all but worthless.
To put it another way, if superintelligences are competing with each other and self-modifying in order to do so, predictions about the qualities those superintelligences will possess are all but worthless.
We cannot be sure that there are difficulties beyond our comprehension but we are certainly able to assign probabilities to that hypothesis based on what we know. I would be justifiably shocked if something we could call a super-intelligence couldn’t be formed based on knowledge that is accessible to us, even if the process of putting the seed of a super-intelligence together is beyond us.
Humans aren’t even remotely optimised for generalised intelligence, it’s just a trick we picked up to, crudely speaking, get laid. There is no reason that a intelligence of the form “human thinking minus the parts that suck and a bit more of the parts that don’t suck” couldn’t be created using the knowledge available to us and that is something we can easily place a high probability on. Then you run the hardware at more than 60hz.
Oh, I agree. We just don’t know what self-modifications will be necessary to achieve non-speed-based optimizations.
To put it another way, if superintelligences are competing with each other and self-modifying in order to do so, predictions about the qualities those superintelligences will possess are all but worthless.
On this I totally agree!