No, the KataGo paper explicitly states at the start of page 4:
”Self play games used Tromp-Taylor rules [21] modified to not require capturing stones within pass-aliveterritory”
Had KataGo been trained on unmodified Tromp-Taylor rules, the attack would not have worked. The attack only works because the authors are having KataGo play under a different ruleset than it was trained on.
If I have the details right, I am honestly very confused about what the authors are trying to prove with this paper. Given their Twitter announcement claimed that the rulesets were the same my best guess is simply that it was an oversight on their part.
(EDIT: this modification doesn’t matter, the authors are right, I am wrong. See my comment below)
Actually this modification shouldn’t matter. After looking into the definition of pass-alive, the dead stones in the adversarial attacks are clearly not pass-alive.
Under both unmodified and pass-alive modified tromp-taylor rules, KataGo would lose here and its surprising that self-play left such a weakness.
The authors are definitely onto something, and my original claim that the attack only works due to kataGo being trained under a different rule-set is incorrect.
It doesn’t matter whether the dead stones are pass-alive. It matters whether the white stones surrounding the territory they’re in are pass-alive.
Having said that, in e.g. the first example position shown on the attackers’ webpage those white stones are not pass-alive, so the situation isn’t quite “this is a position in which KG would have won under its training conditions”. But it is a position that superficially looks like such a position, which I think is relevant since what’s going on with this attack is that they’ve found positions where KataGo’s “snap judgement”, when it gets little or no searching, gets it wrong.
No. KataGo loses in their examples because it doesn’t capture stones within pass-alive territory. It’s training rules are modified so it doesn’t need to do that.
The KataGo paper says of its training, “Self-play games used Tromp-Taylor rules modified to not require capturing stones within pass-alive territory”.
It sounds to me like this is the same scoring system as used in the adversarial attack paper, but I don’t know enough about Go to be sure.
No, the KataGo paper explicitly states at the start of page 4:
”Self play games used Tromp-Taylor rules [21] modified to not require capturing stones within pass-aliveterritory”
Had KataGo been trained on unmodified Tromp-Taylor rules, the attack would not have worked. The attack only works because the authors are having KataGo play under a different ruleset than it was trained on.
If I have the details right, I am honestly very confused about what the authors are trying to prove with this paper. Given their Twitter announcement claimed that the rulesets were the same my best guess is simply that it was an oversight on their part.
(EDIT: this modification doesn’t matter, the authors are right, I am wrong. See my comment below)
Actually this modification shouldn’t matter. After looking into the definition of pass-alive, the dead stones in the adversarial attacks are clearly not pass-alive.
Under both unmodified and pass-alive modified tromp-taylor rules, KataGo would lose here and its surprising that self-play left such a weakness.
The authors are definitely onto something, and my original claim that the attack only works due to kataGo being trained under a different rule-set is incorrect.
It doesn’t matter whether the dead stones are pass-alive. It matters whether the white stones surrounding the territory they’re in are pass-alive.
Having said that, in e.g. the first example position shown on the attackers’ webpage those white stones are not pass-alive, so the situation isn’t quite “this is a position in which KG would have won under its training conditions”. But it is a position that superficially looks like such a position, which I think is relevant since what’s going on with this attack is that they’ve found positions where KataGo’s “snap judgement”, when it gets little or no searching, gets it wrong.
No. KataGo loses in their examples because it doesn’t capture stones within pass-alive territory. It’s training rules are modified so it doesn’t need to do that.