You might be interested in my post Value Uncertainty and the Singleton Scenario where I suggested (based on an idea of Nick Bostrom and Toby Ord) another way of handling uncertainty about your utility function, which perhaps gives more intuitive results in these cases.
I consider these results perfectly intuitive, why shouldn’t they be? 3^^^3 is a really big number, it makes sense you have to be really careful around it.
You might be interested in my post Value Uncertainty and the Singleton Scenario where I suggested (based on an idea of Nick Bostrom and Toby Ord) another way of handling uncertainty about your utility function, which perhaps gives more intuitive results in these cases.
I consider these results perfectly intuitive, why shouldn’t they be? 3^^^3 is a really big number, it makes sense you have to be really careful around it.