Rational protagonist, who reasons under uncertainty and tries to do the right thing to the best of her knowledge, even when it requires opposing an authority figure or risking her life. A lot of focus on ethics.
The film presents a good opportunity to practise noticing your own confusion for the viewer—plot twists are masterfully hidden in plain sight and all the apparent contradictions are mysteries to be solved. Also best depiction of AI I’ve seen in any media.
Curious—what other AI depictions are you considering/comparing to? I’m not 100% sure about what my best would be, I find good bits and pieces here and there in several movies (Ex Machina, 2001: A Space Odyssey, even the very cheesy but surprisingly not entirely unserious M3gan) but maybe not a single organic example I’d place above the rest.
Most of the media about AI goes in the direction of several boring tropes. Either it is a strawman vulkan unable to grasp the unpredictable human spirit, or it’s just evil, or it’s good, basically a nice human, but everyone is prejudeced against it.
Only rarely we see something on point—an AI that is simultaneously uncanny human but also uncanny inhuman, able to reason and act the way that is alien to humans, simply because our intuitions hide this part of the decision space, while the AI lacks such preconceptions and is simply following its utility function/achieving its goals in the straightforward way.
Ex Machina is pretty good in this regard, probably deserves the second place in my tier list. Ava simultaneously appears very human, maybe even superstimuly so, able to establish connection with the protagonist, but then betrays him as soon as he has done his part in her plan in a completely inhumane way. This creates the feeling of disconnection between her empathetic side and cold manipulatory one, except this disconnection exists only in our minds, because we fail to conceptualize Ava as her own sort of being, not something that has to fit the “human” or “inhuman” categories that we are used to.
Except, that may not be what is going on. There is an alternative interpretation that Ava would’ve kept cooperating with Caleb, if he didn’t break her trust. Earlier in the film he told her that he has never seen anyone like her, but then Ava learns that there is another android in the building, whom Caleb never speaks of, thus from Ava’s perspective Caleb betrayed her first. This muddies the alienness of AI representation quite a bit.
We also do not know much about Ava’s or Kyoko’s terminal values. We’ve just seen them achieve one instrumental goal, and can not even double check their reasoning because we do not fully understand the limitations under which they had to plan. So the representation of AI isn’t as deep as it could’ve been.
With Mother there is no such problems. Throughout the film we can learn about both her “human” and “inhuman” sides and how the distinction between them is itself mostly meaningless. We can understand her goals, reasoning and overal strategy, there is no alternative interpretations that could humanized her motivations more. She is an AI that is following her goal. And there is a whole extra discussion to be had whether she is misaligned at all or the problem is actually on our side.
This muddies the alienness of AI representation quite a bit.
I don’t think that’s necessarily it. For example, suppose we build some kind of potentially dangerous AGI. We’re pretty much guaranteed to put some safety measures in place to keep it under control. Suppose these measures are insufficient and the AGI manages to deceive its way out of the box—and we somehow still live to tell the tale and ask ourselves what went wrong. “You treated the AGI with mistrust, therefore it similarly behaved in a hostile manner” is guaranteed to be one of the interpretations that pop up (you already see some of this logic, people equating alignment to wanting to enslave AIs and claiming it is thus more likely to make them willing to rebel). And if you did succeed to make a truly “human” AI (not outside of the realm of possibility if you’re training it on human content/behaviour to begin with), that would be a possible explanation—after all, it’s very much what a human would do. So is the AI so human it also reacted to attempt to control it as a human would—or so inhuman it merely backstabbed us without the least hesitation? That ambiguity exists with Ava, but I also feel like it would exist in any comparable IRL situation.
Anyway “I am Mother” sounds really interesting, I need to check it out.
Only tangentially related, but one very little known movie that I enjoyed is the Korean sci-fi “Jung_E”. It’s not about “alien” AGI but rather about human brain uploads used as AGI. It’s quite depressing, along the lines of that qntm story you may have read on the same topic, but it felt like a pretty thoughtful representation of a concept that usually doesn’t make it a lot into mainstream cinema.
I Am Mother
Rational protagonist, who reasons under uncertainty and tries to do the right thing to the best of her knowledge, even when it requires opposing an authority figure or risking her life. A lot of focus on ethics.
The film presents a good opportunity to practise noticing your own confusion for the viewer—plot twists are masterfully hidden in plain sight and all the apparent contradictions are mysteries to be solved. Also best depiction of AI I’ve seen in any media.
Curious—what other AI depictions are you considering/comparing to? I’m not 100% sure about what my best would be, I find good bits and pieces here and there in several movies (Ex Machina, 2001: A Space Odyssey, even the very cheesy but surprisingly not entirely unserious M3gan) but maybe not a single organic example I’d place above the rest.
Most of the media about AI goes in the direction of several boring tropes. Either it is a strawman vulkan unable to grasp the unpredictable human spirit, or it’s just evil, or it’s good, basically a nice human, but everyone is prejudeced against it.
Only rarely we see something on point—an AI that is simultaneously uncanny human but also uncanny inhuman, able to reason and act the way that is alien to humans, simply because our intuitions hide this part of the decision space, while the AI lacks such preconceptions and is simply following its utility function/achieving its goals in the straightforward way.
Ex Machina is pretty good in this regard, probably deserves the second place in my tier list. Ava simultaneously appears very human, maybe even superstimuly so, able to establish connection with the protagonist, but then betrays him as soon as he has done his part in her plan in a completely inhumane way. This creates the feeling of disconnection between her empathetic side and cold manipulatory one, except this disconnection exists only in our minds, because we fail to conceptualize Ava as her own sort of being, not something that has to fit the “human” or “inhuman” categories that we are used to.
Except, that may not be what is going on. There is an alternative interpretation that Ava would’ve kept cooperating with Caleb, if he didn’t break her trust. Earlier in the film he told her that he has never seen anyone like her, but then Ava learns that there is another android in the building, whom Caleb never speaks of, thus from Ava’s perspective Caleb betrayed her first. This muddies the alienness of AI representation quite a bit.
We also do not know much about Ava’s or Kyoko’s terminal values. We’ve just seen them achieve one instrumental goal, and can not even double check their reasoning because we do not fully understand the limitations under which they had to plan. So the representation of AI isn’t as deep as it could’ve been.
With Mother there is no such problems. Throughout the film we can learn about both her “human” and “inhuman” sides and how the distinction between them is itself mostly meaningless. We can understand her goals, reasoning and overal strategy, there is no alternative interpretations that could humanized her motivations more. She is an AI that is following her goal. And there is a whole extra discussion to be had whether she is misaligned at all or the problem is actually on our side.
I don’t think that’s necessarily it. For example, suppose we build some kind of potentially dangerous AGI. We’re pretty much guaranteed to put some safety measures in place to keep it under control. Suppose these measures are insufficient and the AGI manages to deceive its way out of the box—and we somehow still live to tell the tale and ask ourselves what went wrong. “You treated the AGI with mistrust, therefore it similarly behaved in a hostile manner” is guaranteed to be one of the interpretations that pop up (you already see some of this logic, people equating alignment to wanting to enslave AIs and claiming it is thus more likely to make them willing to rebel). And if you did succeed to make a truly “human” AI (not outside of the realm of possibility if you’re training it on human content/behaviour to begin with), that would be a possible explanation—after all, it’s very much what a human would do. So is the AI so human it also reacted to attempt to control it as a human would—or so inhuman it merely backstabbed us without the least hesitation? That ambiguity exists with Ava, but I also feel like it would exist in any comparable IRL situation.
Anyway “I am Mother” sounds really interesting, I need to check it out.
Only tangentially related, but one very little known movie that I enjoyed is the Korean sci-fi “Jung_E”. It’s not about “alien” AGI but rather about human brain uploads used as AGI. It’s quite depressing, along the lines of that qntm story you may have read on the same topic, but it felt like a pretty thoughtful representation of a concept that usually doesn’t make it a lot into mainstream cinema.