So many of the comments here seem designed to illustrate the extreme difficulty, even for intelligent humans interested in rationality, and trying hard to participate usefully in a conversation about hard-edged situations of perceived non-trivial import, to avoid fairly simplistic anthropomorphisms of one kind or another.
Saying, of a supposed super-intelligent AI—one that works by being able to parallel, somehow, the ‘might as well be magic’ bits of intelligence that we currently have at best a crude assembly of speculative guesses for—any version of “of course, it would do X”, seems - well—foolish.
So many of the comments here seem designed to illustrate the extreme difficulty, even for intelligent humans interested in rationality, and trying hard to participate usefully in a conversation about hard-edged situations of perceived non-trivial import, to avoid fairly simplistic anthropomorphisms of one kind or another.
Saying, of a supposed super-intelligent AI—one that works by being able to parallel, somehow, the ‘might as well be magic’ bits of intelligence that we currently have at best a crude assembly of speculative guesses for—any version of “of course, it would do X”, seems - well—foolish.