I think all it shows is that Turing’s original suggestion of 30% success for 5 minutes with average interrogators was probably overoptimistic. Those particular stipulations were never, it seems to me, core to what Turing was saying, and the sample conversations in his article make it clear that even if he said “average” he was actually thinking of a rather higher standard of interrogation than “Eugene” got.
And of course the whole “13-year old immigrant who doesn’t speak English very well” thing is rather a cheat. Here, I’ve got a program that passes the Turing test. It simulates a person who doesn’t know how to use a computer keyboard.
It passed Turing’s original criteria. I don’t see how I can’t consider that a genuine pass, however we feel about the methods used.
I think all it shows is that Turing’s original suggestion of 30% success for 5 minutes with average interrogators was probably overoptimistic. Those particular stipulations were never, it seems to me, core to what Turing was saying, and the sample conversations in his article make it clear that even if he said “average” he was actually thinking of a rather higher standard of interrogation than “Eugene” got.
And of course the whole “13-year old immigrant who doesn’t speak English very well” thing is rather a cheat. Here, I’ve got a program that passes the Turing test. It simulates a person who doesn’t know how to use a computer keyboard.
I agree. Which is why we need better tests! http://lesswrong.com/r/discussion/lw/kc8/come_up_with_better_turing_tests/