Bertram will soon overtake Albert and that would be a significant threat to Albert’s friendly supergoal.
What is that “friendly supergoal”? It looks awfully similar to “I will not tolerate any challenges to my power”.
Most goals include “I will not tolerate any challenges to my power” as a subgoal. Tolerating challenges to power to execute goals reduces the likelihood of acheiving them.
There are plenty of other things that look similar to that—such as, “I will not let an UFAI take over our future light cone”
What is that “friendly supergoal”? It looks awfully similar to “I will not tolerate any challenges to my power”.
Most goals include “I will not tolerate any challenges to my power” as a subgoal. Tolerating challenges to power to execute goals reduces the likelihood of acheiving them.
There are plenty of other things that look similar to that—such as, “I will not let an UFAI take over our future light cone”