I’m confused by the judges’ lack of use of the search capabilities. I think we need more information about how the judges are selected. It isn’t clear to me that they are representative of the kinds of people we would expect to be acting as judges in future scenarios of superintelligent AI debates. For example, a simple and obvious tactic would be to ask both AIs what one ought to search for in order to be able to verify their arguments. An AI that can make very compelling arguments still can’t change the true facts that are known to humanity to suit their needs.
I’m confused by the judges’ lack of use of the search capabilities. I think we need more information about how the judges are selected. It isn’t clear to me that they are representative of the kinds of people we would expect to be acting as judges in future scenarios of superintelligent AI debates. For example, a simple and obvious tactic would be to ask both AIs what one ought to search for in order to be able to verify their arguments. An AI that can make very compelling arguments still can’t change the true facts that are known to humanity to suit their needs.