Shmi comments on Why are we sure that AI will “want” something?

[Shmi]

Incidentally, the drive for accuracy generates a drive for a form of self-preservation.

I am not sure this is an accurate assertion. Would be nice to have some ML-based tests of it.