Daniel Kokotajlo comments on Metaphors for AI, and why I don’t like them

[Daniel Kokotajlo]

agency co-evolved in humans does not mean that they cannot be decoupled in AIs.

I believe that they CAN be decoupled, but that they won’t be, because there are fairly strong incentives to train and deploy agentic AGIs.