According to Jaynes, it’s actually not—I don’t have the page number on me, unfortunately. But the way he does it is by discretizing the space of possibilities, and taking the limit as the number of discrete possibilities goes to infinity. It’s not the limit of the entropy H, since that goes to infinity, it’s the limit of H—log(n). It turns out to be a little different from integrating p*Log(p).
According to Jaynes, it’s actually not—I don’t have the page number on me, unfortunately. But the way he does it is by discretizing the space of possibilities, and taking the limit as the number of discrete possibilities goes to infinity. It’s not the limit of the entropy H, since that goes to infinity, it’s the limit of H—log(n). It turns out to be a little different from integrating p*Log(p).