The executive order was intended to limit various risks from AI… none of which were at all related to human extinction, except maybe bioweapons.
But note this from the EO:
(k) The term “dual-use foundation model” means an AI model that is trained on broad data; generally uses self-supervision; contains at least tens of billions of parameters; is applicable across a wide range of contexts; and that exhibits, or could be easily modified to exhibit, high levels of performance at tasks that pose a serious risk to security, national economic security, national public health or safety, or any combination of those matters, such as by:
...
(iii) permitting the evasion of human control or oversight through means of deception or obfuscation.
A quick nitpick:
You say:
But note this from the EO:
Ah. I don’t think the writers meant that in terms of ASI killing everyone, but yeah, it’s kind of related.