I agree that 10% chance of success is better than near zero, and furthermore I agree that expected utility maximization means that putting in a great deal of effort to achieve a positive outcome is wiser than saying “oh well, we’re doomed anyway, might as well party hard and make the most of the time we have left”. However, the question is whether, if FAI has a low probability of success, are other possibilities, e.g. tool AI a better option to pursue?
I agree that 10% chance of success is better than near zero, and furthermore I agree that expected utility maximization means that putting in a great deal of effort to achieve a positive outcome is wiser than saying “oh well, we’re doomed anyway, might as well party hard and make the most of the time we have left”. However, the question is whether, if FAI has a low probability of success, are other possibilities, e.g. tool AI a better option to pursue?