This depends how powerful the answerer is. If it’s as good as a human expert, it’s probably not dangerous—at least, human experts aren’t. Certainly, I would rather keep such a system out of the hands of criminals or the insane—but it doesn’t seem like that system, alone, would be a serious risk to humanity.
This depends how powerful the answerer is. If it’s as good as a human expert, it’s probably not dangerous—at least, human experts aren’t. Certainly, I would rather keep such a system out of the hands of criminals or the insane—but it doesn’t seem like that system, alone, would be a serious risk to humanity.
Human experts are dangerous. Ones that are easily copiable and do not have any scruples built in are way more dangerous.