That’s the other thing about analogies, of course—I’m very carefully picking which analogies to make, using knowledge not itself contained in the analogy. AIs are not like humans, their advent won’t be like the advent of human intelligence. The main point of this analogy is to avoid absurdity bias—to try to appreciate how surprising intelligence, like the first replicator, would have seemed at the time without benefit of hindsight.
That’s the other thing about analogies, of course—I’m very carefully picking which analogies to make, using knowledge not itself contained in the analogy. AIs are not like humans, their advent won’t be like the advent of human intelligence. The main point of this analogy is to avoid absurdity bias—to try to appreciate how surprising intelligence, like the first replicator, would have seemed at the time without benefit of hindsight.