ikrase comments on The idiot savant AI isn’t an idiot

[ikrase]

The problem is that unlike a human, the AI might succeed.

What would it mean for an AI to not follow it’s programming?