It’s certainly possible to convince people of a proposition that is false; consider Eliezer doing the Ai-box experiment. In the Ai-box example, Eliezer understands that the proposition is false, but that need not be true in general; you can be bad at thinking in one way (and thus not understand that some proposition is false) but good at thinking in other ways (and thus be able to readily convince other people of the false proposition).
In other words, instead of a stupid reasoner and a clever killer, a stupid reasoner and a clever convincer.
In that case, though, you’re afraid of the man’s axe more than his mind.
No, because it works as metaphor too.
It’s certainly possible to convince people of a proposition that is false; consider Eliezer doing the Ai-box experiment. In the Ai-box example, Eliezer understands that the proposition is false, but that need not be true in general; you can be bad at thinking in one way (and thus not understand that some proposition is false) but good at thinking in other ways (and thus be able to readily convince other people of the false proposition).
In other words, instead of a stupid reasoner and a clever killer, a stupid reasoner and a clever convincer.