What I wrote above may be a bit misleading. The issue isn’t that you have additional terms for conjunctions of the Bi, but that the weights Pr(Bi∣M) sum to more than 1. In particular, consider the case when AI Beauty gets exactly one bit of input. Then for y=0 or 1,
What I wrote above may be a bit misleading. The issue isn’t that you have additional terms for conjunctions of the Bi, but that the weights Pr(Bi∣M) sum to more than 1. In particular, consider the case when AI Beauty gets exactly one bit of input. Then for y=0 or 1,
and 5/8+5/8=5/4>1. If we try the same decomposition as in my previous comment, then usingPr(H∣X2(y),M)=1/2.5=2/5, we find
and everything is still consistent.