Prelec’s formal results hold for large populations, but it held up well experimentally with 30-50 participants
Wait, wait, let me understand this. It’s the robust knowledge aggregation part that held up experimentally, not the truth serum part, right? In this experiment the participants had very few incentives to game the system, and they didn’t even have a full understanding of the system’s internals. In contrast, prediction markets are supposed to work even if everybody tries to game them constantly.
Manipulability is addressed experimentally in a different working paper. The participants weren’t told the internals and the manipulations were mostly hypothetical, but honesty was the highest scoring strategy in what they considered.
In some sense, it’s easy to manipulate BTS to give a particular answer. The only problem is you might end up owing the operator incredibly large sums of money. If payments to and from the mechanism aren’t being made, BTS is worthless if people try to game it. I should have a post up shortly about a better mechanism.
Wait, wait, let me understand this. It’s the robust knowledge aggregation part that held up experimentally, not the truth serum part, right? In this experiment the participants had very few incentives to game the system, and they didn’t even have a full understanding of the system’s internals. In contrast, prediction markets are supposed to work even if everybody tries to game them constantly.
Manipulability is addressed experimentally in a different working paper. The participants weren’t told the internals and the manipulations were mostly hypothetical, but honesty was the highest scoring strategy in what they considered.
In some sense, it’s easy to manipulate BTS to give a particular answer. The only problem is you might end up owing the operator incredibly large sums of money. If payments to and from the mechanism aren’t being made, BTS is worthless if people try to game it. I should have a post up shortly about a better mechanism.