I agree with this so much! Like you I very much expect benefits to be much greater than harms pre superintelligence. If people are following the default algorithm “Deploy all AI which is individually net positive for humanity in the near term” (which is very reasonable from many perspectives), they will deploy TEDAI and not slow down until it’s too late.
I expect AI to get better at research slightly sooner than you expect.
I agree with this so much! Like you I very much expect benefits to be much greater than harms pre superintelligence. If people are following the default algorithm “Deploy all AI which is individually net positive for humanity in the near term” (which is very reasonable from many perspectives), they will deploy TEDAI and not slow down until it’s too late.
I expect AI to get better at research slightly sooner than you expect.