Oh, I see, thanks for the explanation. In that case, I basically agree with your original comment: it seems likely that eventually we will have AI systems that simply play well with their environment. However, I think that by that point AI systems will have a good concept of “human”, because humans are a natural category / the “human” concept carves reality at its joints.
(I anticipate pushback on the claim that the “human” concept is natural; I’m not going to defend it here, though if the claim is unclear I’m happy to clarify.)
Oh, I see, thanks for the explanation. In that case, I basically agree with your original comment: it seems likely that eventually we will have AI systems that simply play well with their environment. However, I think that by that point AI systems will have a good concept of “human”, because humans are a natural category / the “human” concept carves reality at its joints.
(I anticipate pushback on the claim that the “human” concept is natural; I’m not going to defend it here, though if the claim is unclear I’m happy to clarify.)