For an informational approach, we don’t need that much internal redundancy or persistency. Even an eddy is plenty internally redundant and persistent: I can take a video of an eddy flow, cover up a random quarter of it, and have a pretty decent guess at what that covered chunk looks like by looking at its surroundings. Very roughly speaking, that’s all the redundancy we need. Similarly for persistency: I can take a video of an eddy, cut a random contiguous quarter of the frames, and have a pretty decent guess at what those middle frames look like. Very roughly speaking, that’s all the persistency we need.
I think that works for satisfying the natural latent criterion, but interoperable semantics has a skewness/metric requirement you haven’t addressed yet? Like if you show someone a video of an eddy and tell them this is what’s called an “eddy”, what lets them infer that the “eddy” is the eddy (and could be other eddies in other circumstances), rather than e.g. the “eddy” referring to the fluid or the video or the background or the center or whatever? You need some metric of importance, and the only such metric information theory has is evidence, but evidence is, as far as I can tell, not the right metric for this in general.
I see.
For an informational approach, we don’t need that much internal redundancy or persistency. Even an eddy is plenty internally redundant and persistent: I can take a video of an eddy flow, cover up a random quarter of it, and have a pretty decent guess at what that covered chunk looks like by looking at its surroundings. Very roughly speaking, that’s all the redundancy we need. Similarly for persistency: I can take a video of an eddy, cut a random contiguous quarter of the frames, and have a pretty decent guess at what those middle frames look like. Very roughly speaking, that’s all the persistency we need.
I think that works for satisfying the natural latent criterion, but interoperable semantics has a skewness/metric requirement you haven’t addressed yet? Like if you show someone a video of an eddy and tell them this is what’s called an “eddy”, what lets them infer that the “eddy” is the eddy (and could be other eddies in other circumstances), rather than e.g. the “eddy” referring to the fluid or the video or the background or the center or whatever? You need some metric of importance, and the only such metric information theory has is evidence, but evidence is, as far as I can tell, not the right metric for this in general.