The idea of “mathematical proof” is useful if someone has never thought of the concept before. For more specifics you need to look at individual proposed proofs. Similarly, people have proposed specific approaches for how to develop a safe AI, which we can look at if we want to know “which individual steps are valid or safe” but having a more general concept seems useful if you hadn’t thought of that before. (I did state that this “may be trivial or obvious for a lot of people”, and also talked about what I personally got out of thinking this way in the paragraph just below the box.)
The idea of “mathematical proof” is useful if someone has never thought of the concept before. For more specifics you need to look at individual proposed proofs. Similarly, people have proposed specific approaches for how to develop a safe AI, which we can look at if we want to know “which individual steps are valid or safe” but having a more general concept seems useful if you hadn’t thought of that before. (I did state that this “may be trivial or obvious for a lot of people”, and also talked about what I personally got out of thinking this way in the paragraph just below the box.)