I agree the world right now is super bad. However, “delay AGI until we really know what we’re doing” doesn’t seem all that much harder than “delay AGI forever”, and most people do agree that alignment is solvable.[1] Right now, we still have far more people working on capability (and they’ve been working on it for far longer); if we could change this, alignment may even get solved relatively quickly.
I agree the world right now is super bad. However, “delay AGI until we really know what we’re doing” doesn’t seem all that much harder than “delay AGI forever”, and most people do agree that alignment is solvable.[1] Right now, we still have far more people working on capability (and they’ve been working on it for far longer); if we could change this, alignment may even get solved relatively quickly.
Eliezer has said this explicitly, e.g. on the sam harris podcast (CTRL+F “alignment is impossible”)