As you note, we already have some constraints on that. I am fairly comfortable saying that the effectiveness is limited and most have some intuitive level of understanding this. Imposing such constraints don’t stop the target from existing (which I don’t think you are claiming). Efforts to make the approach more effective we run into the problem of cures being worse than the disease.
As others have noted, the AIs that are of concern will be smarter, and faster, than humans imposing the constraints. Given the ability of humans to get around these constraints (generally quicker that the regulators can react) one might expect:
The AI will be much better at that task
The path to a cure being worse than the disease may be fast tracked as well and we have to worry more about humans than the AI.
As you note, we already have some constraints on that. I am fairly comfortable saying that the effectiveness is limited and most have some intuitive level of understanding this. Imposing such constraints don’t stop the target from existing (which I don’t think you are claiming). Efforts to make the approach more effective we run into the problem of cures being worse than the disease.
As others have noted, the AIs that are of concern will be smarter, and faster, than humans imposing the constraints. Given the ability of humans to get around these constraints (generally quicker that the regulators can react) one might expect:
The AI will be much better at that task
The path to a cure being worse than the disease may be fast tracked as well and we have to worry more about humans than the AI.