I think my personal view is something like,
“Things seem super high-EV in expectation. In many ways, we as a species seem to be in a highly opportunistic setting. Let’s generally try to be as careful as possible to make sure we don’t mess up.”
Note that high-EV does not mean high-probability. It could be that we have a 0.1% chance of surviving, as a species, but if we do, there would be many orders of magnitude net benefit. I use this not because I believe we have a 0.1% chance, but rather because I think it’s a pretty reasonable lower bound.
I think my personal view is something like, “Things seem super high-EV in expectation. In many ways, we as a species seem to be in a highly opportunistic setting. Let’s generally try to be as careful as possible to make sure we don’t mess up.”
Note that high-EV does not mean high-probability. It could be that we have a 0.1% chance of surviving, as a species, but if we do, there would be many orders of magnitude net benefit. I use this not because I believe we have a 0.1% chance, but rather because I think it’s a pretty reasonable lower bound.