What plateau? Why pause now (vs say 10 years ago)? Why not wait until after the singularity and impose a “long reflection” when we will be in an exponentially better place to consider such questions.
Singularity 5-10 years from now vs 15-20 years from now determines whether or not some people I personally know and care about will be alive.
Every second we delay the singularity leads to a “cosmic waste” as millions more galaxies move permanently behind the event horizon defined by the expanding universe
Slower is not prima facia safer. To the contrary, the primary mechanism for slowing down AGI is “concentrate power in the hands of a small number of decision makers,” which in my current best guess increases risk.
There is no bright line for how much slower we should go. If we accept without evidence that we should slow down AGI by 10 years, why not 50? why not 5000?
What plateau? Why pause now (vs say 10 years ago)? Why not wait until after the singularity and impose a “long reflection” when we will be in an exponentially better place to consider such questions.
Singularity 5-10 years from now vs 15-20 years from now determines whether or not some people I personally know and care about will be alive.
Every second we delay the singularity leads to a “cosmic waste” as millions more galaxies move permanently behind the event horizon defined by the expanding universe
Slower is not prima facia safer. To the contrary, the primary mechanism for slowing down AGI is “concentrate power in the hands of a small number of decision makers,” which in my current best guess increases risk.
There is no bright line for how much slower we should go. If we accept without evidence that we should slow down AGI by 10 years, why not 50? why not 5000?