That makes sense. In my post I’m saying that entropy is whatever binary string assignment you want, which does not depend on the probability distribution you’re using to weight things. And then if you want the minimum average string length, it becomes in terms of the probability distribution.
Ah, I missed this on a first skim and only got it recently, so some of my comments are probably missing this context in important ways. Sorry, that’s on me.
That makes sense. In my post I’m saying that entropy is whatever binary string assignment you want, which does not depend on the probability distribution you’re using to weight things. And then if you want the minimum average string length, it becomes in terms of the probability distribution.
Ah, I missed this on a first skim and only got it recently, so some of my comments are probably missing this context in important ways. Sorry, that’s on me.