Phil, in suggesting to replace an unFriendly AI that converges on a bad utility by a collection of AIs that never converge, you are effectively trying to improve the situation by injecting randomness in the system.
Your perception of lawful extrapolation of values as “stasis” seems to stem from intuitions about free will. If you look at the worldline as a 4D crystal, everything is set in stone, according to laws of physics. The future is determined by the content of the world, in particular by actors embedded in it. If you allow AI to fiddle with the development of humanity, you can view it as a change in underlying laws of physics in which humanity is embedded, not as a change on the level you’d recognize as interference in your decision-making. If it must, this change can drive the events in ways so locally insignificant you’d need to be a superintelligence yourself to tell them from chance, but it could act as a special “luck” that in the end results in the best possible outcome given the allowed level of interference.
Phil, in suggesting to replace an unFriendly AI that converges on a bad utility by a collection of AIs that never converge, you are effectively trying to improve the situation by injecting randomness in the system.
Your perception of lawful extrapolation of values as “stasis” seems to stem from intuitions about free will. If you look at the worldline as a 4D crystal, everything is set in stone, according to laws of physics. The future is determined by the content of the world, in particular by actors embedded in it. If you allow AI to fiddle with the development of humanity, you can view it as a change in underlying laws of physics in which humanity is embedded, not as a change on the level you’d recognize as interference in your decision-making. If it must, this change can drive the events in ways so locally insignificant you’d need to be a superintelligence yourself to tell them from chance, but it could act as a special “luck” that in the end results in the best possible outcome given the allowed level of interference.