I guess I’m imagining transparency tools that combine to say “OK”, “dangerous”, or “don’t know”, and the question is how often it has to answer “don’t know”. Given that analysis tools typically only work for certain types of systems, and ML training takes many forms, I suppose you’ll need to take some pains to ensure that your system is compatible with existing transparency tools. But I haven’t explicitly thought about this very much, and am just giving a quick answer.
I guess I’m imagining transparency tools that combine to say “OK”, “dangerous”, or “don’t know”, and the question is how often it has to answer “don’t know”. Given that analysis tools typically only work for certain types of systems, and ML training takes many forms, I suppose you’ll need to take some pains to ensure that your system is compatible with existing transparency tools. But I haven’t explicitly thought about this very much, and am just giving a quick answer.
Or at least not in a recognisably relevant-to-your-question way.