Hi Alex,
I suspect that you might find the following articles interesting:
Information-Theoretic Probing with Minimum Description Length;
Evaluating representations by the complexity of learning low-loss predictors;
A Theory of Usable Information Under Computational Constraints;
A Novel Approach to the Partial Information Decomposition.
Hi Alex,
I suspect that you might find the following articles interesting:
Information-Theoretic Probing with Minimum Description Length;
Evaluating representations by the complexity of learning low-loss predictors;
A Theory of Usable Information Under Computational Constraints;
A Novel Approach to the Partial Information Decomposition.