Unknown, you’re making the assumption that the entity or entities in question will continue to replicate in a fundamentally similar manner to biological organisms, and I think that’s a flawed assumption. My person bias is toward believing that an AI would not so much replicate, as envelope. Even if I am wrong, Eliezer’s previous points about our concept of intelligence being a very small portion of the space of possible intelligences holds here.
Unknown, you’re making the assumption that the entity or entities in question will continue to replicate in a fundamentally similar manner to biological organisms, and I think that’s a flawed assumption. My person bias is toward believing that an AI would not so much replicate, as envelope. Even if I am wrong, Eliezer’s previous points about our concept of intelligence being a very small portion of the space of possible intelligences holds here.