I used to play a MUD that had a chatbot on it for months in the late 1990s before the people running the game found out and kicked “him” off for violation of the no-bots rule. The chatbot used one specific group chat line and acted somewhat like the hypothetical video poster—mild verbal insults that weren’t quite nasty enough to justify complaining to admin about, potty humor, “shut up [name]” and similar responses to questions, and other behaviors that were believably how a middle-school-aged player with trollish intentions might act.
Lowering the standard of the chatbot’s expected conversational level by giving it the persona of a child or early adolescent speaking in different language than his/her first language does seem like a form of cheating while following the letter of the rules. At a minimum, I’d like to see the chatbot pass as an ordinary adult of at least average intelligence who is a native speaker of the language that the test is conducted in. A fellow professional in a given field would be even better.
I used to play a MUD that had a chatbot on it for months in the late 1990s before the people running the game found out and kicked “him” off for violation of the no-bots rule. The chatbot used one specific group chat line and acted somewhat like the hypothetical video poster—mild verbal insults that weren’t quite nasty enough to justify complaining to admin about, potty humor, “shut up [name]” and similar responses to questions, and other behaviors that were believably how a middle-school-aged player with trollish intentions might act.
Lowering the standard of the chatbot’s expected conversational level by giving it the persona of a child or early adolescent speaking in different language than his/her first language does seem like a form of cheating while following the letter of the rules. At a minimum, I’d like to see the chatbot pass as an ordinary adult of at least average intelligence who is a native speaker of the language that the test is conducted in. A fellow professional in a given field would be even better.