This is a serious concern with any cryptographic system, but it’s unrelated to the accusation that cryptography is security through confusingness. The game is still you vs. the cryptographic design problem, not you vs. an AI.
How do you know that a system that’s currently working is bug free?
On a more general note, most trusted cryptographic systems have source that get’s checked by many people. If you write a cryptographic tool specifically for the purpose of sandboxing this AI the crypto-tool is likely to be reviewed by less people.
A system that gives you a simple bit flag to deny access is easier to check for bugs, it’s less confusing.
It also happens frequently that it doesn’t.
This is a serious concern with any cryptographic system, but it’s unrelated to the accusation that cryptography is security through confusingness. The game is still you vs. the cryptographic design problem, not you vs. an AI.
How do you know that a system that’s currently working is bug free?
On a more general note, most trusted cryptographic systems have source that get’s checked by many people. If you write a cryptographic tool specifically for the purpose of sandboxing this AI the crypto-tool is likely to be reviewed by less people.
A system that gives you a simple bit flag to deny access is easier to check for bugs, it’s less confusing.