MMEU fails as a decision theory that we actually want for the same reason that laypeople’s intuitions about AI fail- it’s rare to have a proper understanding of how powerful the phrases “maximum” and “minimum” are.
As a quick example, actually following MMEU means that a vacuum metastability event is the best thing that could possibly happen to the universe, because it removes the possibility of humanity being tortured for eternity. Add in the fact that it doesn’t allow you to deal with infinitesimals correctly (e.g. Pascal’s Wager should never fail to convince an MMEU agent), and I’m seriously confused as to the usefulness of this.
MMEU fails as a decision theory that we actually want for the same reason that laypeople’s intuitions about AI fail- it’s rare to have a proper understanding of how powerful the phrases “maximum” and “minimum” are. As a quick example, actually following MMEU means that a vacuum metastability event is the best thing that could possibly happen to the universe, because it removes the possibility of humanity being tortured for eternity. Add in the fact that it doesn’t allow you to deal with infinitesimals correctly (e.g. Pascal’s Wager should never fail to convince an MMEU agent), and I’m seriously confused as to the usefulness of this.