sophiesdad: As I understand it, it is not possible for a human to design a machine that is “smarter-than-human”, by definition.
Caledonian: Your understanding is mistaken.
Mr. Caledonian, I’m going to stick by my original statement. Smarter-than-human intelligence will be designed by machines with “around human” intelligence running recursive self-improvement code. It will not start with a human-designed superhuman intelligence. How could a human know what that is? That’s why I’m not sure that all the years of thought going into the meaning of morality, etc. is helpful. If it is impossible for humans to understand what superhuman intelligence and the world around it would be like, just relax and go along for the ride. If we’re destroyed, we’ll never know it. If you’re religious, you’ll be in heaven (great) or hell (sucks). I agree with Tim Tyler (who must not be drinking as much as when he was commenting on Taubes) that we already have machines that perform many tasks, including design tasks, that would be impractical for humans alone.
sophiesdad: As I understand it, it is not possible for a human to design a machine that is “smarter-than-human”, by definition.
Caledonian: Your understanding is mistaken.
Mr. Caledonian, I’m going to stick by my original statement. Smarter-than-human intelligence will be designed by machines with “around human” intelligence running recursive self-improvement code. It will not start with a human-designed superhuman intelligence. How could a human know what that is? That’s why I’m not sure that all the years of thought going into the meaning of morality, etc. is helpful. If it is impossible for humans to understand what superhuman intelligence and the world around it would be like, just relax and go along for the ride. If we’re destroyed, we’ll never know it. If you’re religious, you’ll be in heaven (great) or hell (sucks). I agree with Tim Tyler (who must not be drinking as much as when he was commenting on Taubes) that we already have machines that perform many tasks, including design tasks, that would be impractical for humans alone.