“So an AI that splits itself into two may deviate in capability, but should share the same purpose.”
I cannot see how two initially identical strong AIs sharing the purpose would not start to diverge over time. Strong AI is by definition adaptable (means learning), different set of local conditions (= inputs) must lead to splitting AIs “personality”.
In other words, splitting itself has to end with two “itselfs”, as long as both are “strong”.
“So an AI that splits itself into two may deviate in capability, but should share the same purpose.”
I cannot see how two initially identical strong AIs sharing the purpose would not start to diverge over time. Strong AI is by definition adaptable (means learning), different set of local conditions (= inputs) must lead to splitting AIs “personality”.
In other words, splitting itself has to end with two “itselfs”, as long as both are “strong”.