I agree. “AGI Safety”/”Safe AGI” seems like the best option. if people say, “Let me save you some time and tell you right now that’s impossible” half of the work is done. The other half is just convincing them that we have to do it anyway because otherwise everyone is doomed. (This is of course, as long as they are using “impossible” in a loose sense. If they aren’t, the problem can probably be fixed by saying “our definition of safety is a little bit more loose than the one you’re probably thinking of, but not so much more loose that it becomes easy”).
I agree. “AGI Safety”/”Safe AGI” seems like the best option. if people say, “Let me save you some time and tell you right now that’s impossible” half of the work is done. The other half is just convincing them that we have to do it anyway because otherwise everyone is doomed. (This is of course, as long as they are using “impossible” in a loose sense. If they aren’t, the problem can probably be fixed by saying “our definition of safety is a little bit more loose than the one you’re probably thinking of, but not so much more loose that it becomes easy”).