I’m saying the control systems on the plane constitute an artificial intelligence, advanced enough to do almost all the work of flying the plane but not general enough to do anything unrelated to flying the plane, and (at issue) not friendly enough to tell the pilots “this is likely just a little ice clog, in which case you don’t need to do anything” or, later in the catastrophe, “the single most important part of stall recovery is bringing the plane’s nose back down,” let alone override their panicky incompetence outright and act on such simple suggestions itself.
You could say they died of insufficient friendly AGI, but not from an AGI that was insufficiently friendly.
By that logic, every death everywhere can be attributed to insufficient friendly AGI.
Among the causes, the easiest to prevent was pilot error due to inadequate training .
I’m saying the control systems on the plane constitute an artificial intelligence, advanced enough to do almost all the work of flying the plane but not general enough to do anything unrelated to flying the plane, and (at issue) not friendly enough to tell the pilots “this is likely just a little ice clog, in which case you don’t need to do anything” or, later in the catastrophe, “the single most important part of stall recovery is bringing the plane’s nose back down,” let alone override their panicky incompetence outright and act on such simple suggestions itself.