Smarter-than-human intelligence will be designed by machines with “around human” intelligence running recursive self-improvement code. It will not start with a human-designed superhuman intelligence. How could a human know what that is?
How could the machine know what superhuman intelligence is? If the machine can design machines that are smarter than it, precisely why can’t humans design machines smarter than them?
How could the machine know what superhuman intelligence is? If the machine can design machines that are smarter than it, precisely why can’t humans design machines smarter than them?