The difference is that if the Exxon Mobil CEO internalizes that (s)he is harming the environment, (s)he has to go and get a completely new job, probably building dams or something. But if Sam Altman internalizes that he is increasing our chance of extinction, all he has to do is tell all his capability researchers to work on alignment, and money is still coming in; only now, less of it comes from ChatGPT subscriptions and more of it comes from grants from the Long-Term Future Fund. It’s a much easier and lighter shift. Additionally, he knows that he can go back to working on capabilities once he’s reasonably sure that he’s not going to kill everyone, while the Exxon Mobil CEO knows (s)he can never drill again.
If we frame this as a little indefinite pause that all the tech companies undertake at the same time, to allow them to chill, work on safety, smell the roses, and seem all wise and understanding to the general public, then I think they would be on board. Although the rich and powerful are not exactly known for being able to update their beliefs.
The difference is that if the Exxon Mobil CEO internalizes that (s)he is harming the environment, (s)he has to go and get a completely new job, probably building dams or something. But if Sam Altman internalizes that he is increasing our chance of extinction, all he has to do is tell all his capability researchers to work on alignment, and money is still coming in; only now, less of it comes from ChatGPT subscriptions and more of it comes from grants from the Long-Term Future Fund. It’s a much easier and lighter shift. Additionally, he knows that he can go back to working on capabilities once he’s reasonably sure that he’s not going to kill everyone, while the Exxon Mobil CEO knows (s)he can never drill again.
If we frame this as a little indefinite pause that all the tech companies undertake at the same time, to allow them to chill, work on safety, smell the roses, and seem all wise and understanding to the general public, then I think they would be on board. Although the rich and powerful are not exactly known for being able to update their beliefs.