I agree that we don’t have a precise definition of intelligence, but we do have a very rough consensus on particular examples. That consensus rejects rocks, trees, and apple pies as not intelligent. It also seems to be rejecting paperclip maximizers and happy-face tilers.
I disagree. “Superintelligent” (i.e. really powerful) paperclip maximizers are intelligent.
I agree that we don’t have a precise definition of intelligence, but we do have a very rough consensus on particular examples. That consensus rejects rocks, trees, and apple pies as not intelligent. It also seems to be rejecting paperclip maximizers and happy-face tilers.
I disagree. “Superintelligent” (i.e. really powerful) paperclip maximizers are intelligent.