You cant pay for things in Utils, you can only pay for them in Opportunities.
This is where pascals mugging goes wrong as well; the only reason to not give pascals mugger the money is the possibility of an even greater opportunity coming along later; a mugger that’s more credible, and/or offers an even greater potential payof. (And once any mugger offers INFINITE utility there’s only credibility left to increase.)
That doesn’t work because the expected value of things that you should do, e.g. donating to an effective charity, is far lower than the expected value of a pascal mugging.
I expect an FAI to have at least 10% probability of acquiring infinite computational power. This means donations to MIRI have infinite expected utility.
You cant pay for things in Utils, you can only pay for them in Opportunities.
This is where pascals mugging goes wrong as well; the only reason to not give pascals mugger the money is the possibility of an even greater opportunity coming along later; a mugger that’s more credible, and/or offers an even greater potential payof. (And once any mugger offers INFINITE utility there’s only credibility left to increase.)
That doesn’t work because the expected value of things that you should do, e.g. donating to an effective charity, is far lower than the expected value of a pascal mugging.
I expect an FAI to have at least 10% probability of acquiring infinite computational power. This means donations to MIRI have infinite expected utility.