If I had to say why I’d disagree with a pivotal act framing, PR would probably be the obvious risk, but another risk is that it’s easy to by default politicize this type of thing, and by default there are no guardrails.
It will be extremely tempting to change the world to fit your ideology and politics, and that gets very dangerous very quickly.
Now unfortunately this might really happen, we can be in the unhappy scenario where pivotal acts are required, but if it ever comes to that, they will need to be narrow pivotal acts, and the political system shouldn’t be changed unless it relates to AI Safety. Narrowness is a virtue, and one of the most important ones during pivotal acts.
If I had to say why I’d disagree with a pivotal act framing, PR would probably be the obvious risk, but another risk is that it’s easy to by default politicize this type of thing, and by default there are no guardrails.
It will be extremely tempting to change the world to fit your ideology and politics, and that gets very dangerous very quickly.
Now unfortunately this might really happen, we can be in the unhappy scenario where pivotal acts are required, but if it ever comes to that, they will need to be narrow pivotal acts, and the political system shouldn’t be changed unless it relates to AI Safety. Narrowness is a virtue, and one of the most important ones during pivotal acts.