It’s just point 3 from Omohundro’s The Basic AI drives paper. Didn’t think that’s controversial around here. I don’t think the Cartesian problem is meant to apply to all power levels (since even plain old humans don’t drop anvils on their heads, too often), so the ‘sufficiently’ ought to cover that objection.
It’s just point 3 from Omohundro’s The Basic AI drives paper. Didn’t think that’s controversial around here. I don’t think the Cartesian problem is meant to apply to all power levels (since even plain old humans don’t drop anvils on their heads, too often), so the ‘sufficiently’ ought to cover that objection.
But they do and the reason they mostly don’t is found in natural selection and not some inevitable convergence of intelligence.