If they have a superhuman AGI, they can use it to predict all possible ways people might try to find workarounds for their commandments (e.g., gender transition, neural implants, etc.) and make them impossible.
If I understand you correctly, you are pointing to the fact that values/shards change in response to novel situations. Sure and perhaps even solar system-wide 1984-style regime would over time slowly morph into (something closer to) luxurious fully-automated gay space communism. But that’s a big maybe IMO. If we had good evidence that prosperity loosens and liberalizes societies across historical and cultures contexts plus perhaps solid models of axiological evolution (I don’t know if something like that even exists), my credence in that would be higher. Also, why not use AGI to fix your regime’s fundamental values or at least make them a stable attractor over thousands or millions of years.
(I feel like right now we are mostly doing adversarial worldbuilding)
If they have a superhuman AGI, they can use it to predict all possible ways people might try to find workarounds for their commandments (e.g., gender transition, neural implants, etc.) and make them impossible.
If I understand you correctly, you are pointing to the fact that values/shards change in response to novel situations. Sure and perhaps even solar system-wide 1984-style regime would over time slowly morph into (something closer to) luxurious fully-automated gay space communism. But that’s a big maybe IMO. If we had good evidence that prosperity loosens and liberalizes societies across historical and cultures contexts plus perhaps solid models of axiological evolution (I don’t know if something like that even exists), my credence in that would be higher. Also, why not use AGI to fix your regime’s fundamental values or at least make them a stable attractor over thousands or millions of years.
(I feel like right now we are mostly doing adversarial worldbuilding)