Right. This is the “evolutionary optimality challenge” of Bostrom and Sandberg, which is “If the proposed intervention would result in an enhancement, why have we not already evolved to be that way?”
Gwern’s excellent article on that lists some ways to escape the challenge; I’m not sure which are at play here, but I think dominance is generally a good idea.
Right. This is the “evolutionary optimality challenge” of Bostrom and Sandberg, which is “If the proposed intervention would result in an enhancement, why have we not already evolved to be that way?”
Gwern’s excellent article on that lists some ways to escape the challenge; I’m not sure which are at play here, but I think dominance is generally a good idea.