Regarding your point on ELK: to make the output of the opaque machine learning system counterfactable, wouldn’t it be sufficient to include the whole program trace? Program trace means the results of all the intermediate computations computed along the way. Yet including a program trace wouldn’t help us much if we don’t know what function of that program trace will tell us, for example, whether the machine learning system is deliberately deceiving us.
So yes it’s necessary to have an information set that includes the relevant information, but isn’t the main part of the (ELK) problem to determine what function of that information corresponds to the particular latent variable that we’re looking for?
I agree, this is why I said I am being sloppy with conflating the output and our understanding of the output. We want our understanding of the output to screen off the history.
Regarding your point on ELK: to make the output of the opaque machine learning system counterfactable, wouldn’t it be sufficient to include the whole program trace? Program trace means the results of all the intermediate computations computed along the way. Yet including a program trace wouldn’t help us much if we don’t know what function of that program trace will tell us, for example, whether the machine learning system is deliberately deceiving us.
So yes it’s necessary to have an information set that includes the relevant information, but isn’t the main part of the (ELK) problem to determine what function of that information corresponds to the particular latent variable that we’re looking for?
I agree, this is why I said I am being sloppy with conflating the output and our understanding of the output. We want our understanding of the output to screen off the history.