The statement you are responding to is : ‘align AI first’ impossible.
Emphasis added. In that the reality is, larger and more powerful systems may fail in ways no theory craftable by humans with pre-AGI technology will predict. At all. So the only way to find out how they fail will be to build them, take precautions to limit the damage when they fail, and see what happens.
For example we did not develop computational fluid dynamics until long after the airplane. If you wanted to somehow work out by theory how to build a wing, rather than building an actual wing and testing it in a wind tunnel, that wasn’t going to happen.
Similarly, we could not have impeded the development of the airplane for fear that it might crash or be used to do bad, and CFD was developed through international and large collaborations, so it itself was accelerated by the existence of the airplane. (notably jet airliners flying between the various campuses involved)
The statement you are responding to is : ‘align AI first’ impossible.
Emphasis added. In that the reality is, larger and more powerful systems may fail in ways no theory craftable by humans with pre-AGI technology will predict. At all. So the only way to find out how they fail will be to build them, take precautions to limit the damage when they fail, and see what happens.
For example we did not develop computational fluid dynamics until long after the airplane. If you wanted to somehow work out by theory how to build a wing, rather than building an actual wing and testing it in a wind tunnel, that wasn’t going to happen.
Similarly, we could not have impeded the development of the airplane for fear that it might crash or be used to do bad, and CFD was developed through international and large collaborations, so it itself was accelerated by the existence of the airplane. (notably jet airliners flying between the various campuses involved)