Seeing the equations, it was hard to intuitively grasp why updates work this way. This example made things more intuitive for me:
If an event can have 3 outcomes, and we encounter strong evidence against outcomes B and C, then the update looks like this:
The information about what hypotheses are in the running is important, and pooling the updates can make the evidence look much weaker than it is.
Note that you are making the same mistake than me! Updates are not summarized in the same way as beliefs—for the update the “correct” way is to take an average of the B,C likelihoods:
⎛⎜⎝10.010.01⎞⎟⎠Posterior=⎛⎜⎝111⎞⎟⎠Prior×⎛⎜⎝10.011⎞⎟⎠Refute B×⎛⎜⎝110.01⎞⎟⎠Refute C≠(11+1)Prior×(10.01+12)Refute B×(11+0.012)Refute C≈(10.5)Posterior
This does not invalidate the example though!
Thanks for suggesting, I think it helps clarify the conondrum.
The left hand side of the example is deliberately making the mistake described in your article, as a way to build intuition on why it is a mistake.
(Adding instead of averaging in the update summaries was an unintended mistake)
Thanks for explaining how to summarize updates, it took me a bit to see why averaging works.
Seeing the equations, it was hard to intuitively grasp why updates work this way. This example made things more intuitive for me:
If an event can have 3 outcomes, and we encounter strong evidence against outcomes B and C, then the update looks like this:
⎛⎜⎝111⎞⎟⎠Prior×⎛⎜⎝10.011⎞⎟⎠Refute B×⎛⎜⎝110.01⎞⎟⎠Refute C≠(12)Pooled prior×(11.01)Refute B×(11.01)Refute CThe information about what hypotheses are in the running is important, and pooling the updates can make the evidence look much weaker than it is.
Note that you are making the same mistake than me! Updates are not summarized in the same way as beliefs—for the update the “correct” way is to take an average of the B,C likelihoods:
⎛⎜⎝10.010.01⎞⎟⎠Posterior=⎛⎜⎝111⎞⎟⎠Prior×⎛⎜⎝10.011⎞⎟⎠Refute B×⎛⎜⎝110.01⎞⎟⎠Refute C≠(11+1)Prior×(10.01+12)Refute B×(11+0.012)Refute C≈(10.5)Posterior
This does not invalidate the example though!
Thanks for suggesting, I think it helps clarify the conondrum.
The left hand side of the example is deliberately making the mistake described in your article, as a way to build intuition on why it is a mistake.
(Adding instead of averaging in the update summaries was an unintended mistake)
Thanks for explaining how to summarize updates, it took me a bit to see why averaging works.