Agreed. My main objection to the post is that it considers the involved agents to be optimizing for far future world-states. But I’d say that most people (including academics and AI lab researchers) mostly only think of the next 1% step in front of their nose. The entire game theoretic framing in the arms race etc section seems wrong to me.
Agreed. My main objection to the post is that it considers the involved agents to be optimizing for far future world-states. But I’d say that most people (including academics and AI lab researchers) mostly only think of the next 1% step in front of their nose. The entire game theoretic framing in the arms race etc section seems wrong to me.