Right now, the USG seems to very much be in [prepping for an AI arms race] mode. I hope there’s some way to structure this that is both legal and does not require the explicit consent of the US government. I also somewhat worry that the US government does their own capabilities research, as hinted at in the “datacenters on federal lands” EO. I also also worry that OpenAI’s culture is not sufficiently safety-minded right now to actually sign onto this; most of what I’ve been hearing from them is accelerationist.
Still, I think this letter has value, especially if it has “P.S. We’re making this letter because we think if everyone keeps racing then there’s a noticable risk of everyone dying. We think it would be worse if only we stop, but having everyone stop would be the safest, and we think this opinion of ours should be known publicly”
Right now, the USG seems to very much be in [prepping for an AI arms race] mode. I hope there’s some way to structure this that is both legal and does not require the explicit consent of the US government. I also somewhat worry that the US government does their own capabilities research, as hinted at in the “datacenters on federal lands” EO. I also also worry that OpenAI’s culture is not sufficiently safety-minded right now to actually sign onto this; most of what I’ve been hearing from them is accelerationist.
US Gov isn’t likely to sign: Seems right.
OpenAI isn’t likely to sign: Seems right.
Still, I think this letter has value, especially if it has “P.S. We’re making this letter because we think if everyone keeps racing then there’s a noticable risk of everyone dying. We think it would be worse if only we stop, but having everyone stop would be the safest, and we think this opinion of ours should be known publicly”