This is an interesting direction to explore but as is I don’t have any idea what you mean by understand the go bot and I fear figuring that out would itself require answering more than you want to ask.
For instance, what if I just memorize the source code. I can slowly apply each step on paper and as the adversarial training process has no training data or human expert input if I know the rules of go I can, Chinese room style, fully replicate the best go bot using my knowledge given enough time.
But if that doesn’t count and you don’t just mean be better than them at go then you must have in mind that I’d somehow have the same ‘insights’ as the program. But now to state the challenge we need a precise (mathematical) definition that specifies the insights contained in a trained ML model which means we’ve already solved the problem.
This is an interesting direction to explore but as is I don’t have any idea what you mean by understand the go bot and I fear figuring that out would itself require answering more than you want to ask.
For instance, what if I just memorize the source code. I can slowly apply each step on paper and as the adversarial training process has no training data or human expert input if I know the rules of go I can, Chinese room style, fully replicate the best go bot using my knowledge given enough time.
But if that doesn’t count and you don’t just mean be better than them at go then you must have in mind that I’d somehow have the same ‘insights’ as the program. But now to state the challenge we need a precise (mathematical) definition that specifies the insights contained in a trained ML model which means we’ve already solved the problem.