Only a VNM-rational agent can have preferences in a coherent way, so if we’re talking about aggregating people’s preferences, I don’t see any way to do it other than modeling people as having underlying VNM-rational preferences that fail to perfectly determine their decisions.
[...]
Though of course, humans are not VNM-rational.
Only a VNM-rational agent can have preferences in a coherent way, so if we’re talking about aggregating people’s preferences, I don’t see any way to do it other than modeling people as having underlying VNM-rational preferences that fail to perfectly determine their decisions.
Non-VNM agents satisfying only axiom 1 have coherent preferences… they just don’t mix well with probabilities.
Presumably there would be first be an extrapolation phase resulting in rational preferences.