ryan_greenblatt comments on jacquesthibs’s Shortform

[ryan_greenblatt]

I do think that many of the safety advantages of LLMs come from their understanding of human intentions (and therefore implied values).

Did you mean something different than “AIs understand our intentions” (e.g. maybe you meant that humans can understand the AI’s intentions?).

I think future more powerful AIs will surely be strictly better at understanding what humans intend.

[Seth Herd]

I think future more powerful/​useful AIs will understand our intentions better IF they are trained to predict language. Text corpuses contain rich semantics about human intentions.

I can imagine other AI systems that are trained differently, and I would be more worried about those.

That’s what I meant by current AI understanding our intentions possibly better than future AI.