A multipolar world has boundaries, places where a given agent’s optimization is extremely strong and other places where it barely applies at all. This shape could be itself endorsed on reflection, as an aspect of values, so that an agent prefers others to optimize their own slice of the future, possibly even to help them harden their own ability to do so. This is not soft optimization, others keeping their autonomy can be a strong target, and all such agents could cooperate in maintaining this structure.
Values with this aspect of respect for autonomy won’t be fragile. It’s unclear if this aspect is itself fragile, so that most paths of reflection end up rejecting it. Multipolarity calls this principle to mind, though doesn’t directly install it into anyone’s values. But it might turn out to be helpful in adjusting the paths of reflection in a direction where values-on-reflection end up endorsing it, for agents that don’t have rejection of respect for autonomy a settled part of values yet.
A multipolar world has boundaries, places where a given agent’s optimization is extremely strong and other places where it barely applies at all. This shape could be itself endorsed on reflection, as an aspect of values, so that an agent prefers others to optimize their own slice of the future, possibly even to help them harden their own ability to do so. This is not soft optimization, others keeping their autonomy can be a strong target, and all such agents could cooperate in maintaining this structure.
Values with this aspect of respect for autonomy won’t be fragile. It’s unclear if this aspect is itself fragile, so that most paths of reflection end up rejecting it. Multipolarity calls this principle to mind, though doesn’t directly install it into anyone’s values. But it might turn out to be helpful in adjusting the paths of reflection in a direction where values-on-reflection end up endorsing it, for agents that don’t have rejection of respect for autonomy a settled part of values yet.