This muddies the alienness of AI representation quite a bit.
I don’t think that’s necessarily it. For example, suppose we build some kind of potentially dangerous AGI. We’re pretty much guaranteed to put some safety measures in place to keep it under control. Suppose these measures are insufficient and the AGI manages to deceive its way out of the box—and we somehow still live to tell the tale and ask ourselves what went wrong. “You treated the AGI with mistrust, therefore it similarly behaved in a hostile manner” is guaranteed to be one of the interpretations that pop up (you already see some of this logic, people equating alignment to wanting to enslave AIs and claiming it is thus more likely to make them willing to rebel). And if you did succeed to make a truly “human” AI (not outside of the realm of possibility if you’re training it on human content/behaviour to begin with), that would be a possible explanation—after all, it’s very much what a human would do. So is the AI so human it also reacted to attempt to control it as a human would—or so inhuman it merely backstabbed us without the least hesitation? That ambiguity exists with Ava, but I also feel like it would exist in any comparable IRL situation.
Anyway “I am Mother” sounds really interesting, I need to check it out.
Only tangentially related, but one very little known movie that I enjoyed is the Korean sci-fi “Jung_E”. It’s not about “alien” AGI but rather about human brain uploads used as AGI. It’s quite depressing, along the lines of that qntm story you may have read on the same topic, but it felt like a pretty thoughtful representation of a concept that usually doesn’t make it a lot into mainstream cinema.
I don’t think that’s necessarily it. For example, suppose we build some kind of potentially dangerous AGI. We’re pretty much guaranteed to put some safety measures in place to keep it under control. Suppose these measures are insufficient and the AGI manages to deceive its way out of the box—and we somehow still live to tell the tale and ask ourselves what went wrong. “You treated the AGI with mistrust, therefore it similarly behaved in a hostile manner” is guaranteed to be one of the interpretations that pop up (you already see some of this logic, people equating alignment to wanting to enslave AIs and claiming it is thus more likely to make them willing to rebel). And if you did succeed to make a truly “human” AI (not outside of the realm of possibility if you’re training it on human content/behaviour to begin with), that would be a possible explanation—after all, it’s very much what a human would do. So is the AI so human it also reacted to attempt to control it as a human would—or so inhuman it merely backstabbed us without the least hesitation? That ambiguity exists with Ava, but I also feel like it would exist in any comparable IRL situation.
Anyway “I am Mother” sounds really interesting, I need to check it out.
Only tangentially related, but one very little known movie that I enjoyed is the Korean sci-fi “Jung_E”. It’s not about “alien” AGI but rather about human brain uploads used as AGI. It’s quite depressing, along the lines of that qntm story you may have read on the same topic, but it felt like a pretty thoughtful representation of a concept that usually doesn’t make it a lot into mainstream cinema.