DKL(P||Q)=∑xpx(lnpx−lnqx)=E[IP(X)−IQ(X)]
I think there is a mistake in this equation.IP(X) and IQ(X) are the wrong way round. It should be:DKL(P||Q)=∑xpx(lnpx−lnqx)=E[IQ(X)−IP(X)]
Yep that’s right, thanks! Corrected.
I think there is a mistake in this equation.IP(X) and IQ(X) are the wrong way round. It should be:
DKL(P||Q)=∑xpx(lnpx−lnqx)=E[IQ(X)−IP(X)]
Yep that’s right, thanks! Corrected.