Stuart, it’s not about control groups, but that such test actually would test negatively for blind, who are intelligent. Blind AI would also test negatively, so how is that useful?
Actually physics test is not about getting closer to humans, but about creating something useful. If we can teach program to do physics, we can teach it to do other stuff. And we’re getting somewhere mid narrow and real AI.
Physics problems are an interesting test—you could check for typical human mistakes.
You could throw in an unsolvable problem and see whether you get plausibly human reactions.
Stuart, it’s not about control groups, but that such test actually would test negatively for blind, who are intelligent. Blind AI would also test negatively, so how is that useful?
Actually physics test is not about getting closer to humans, but about creating something useful. If we can teach program to do physics, we can teach it to do other stuff. And we’re getting somewhere mid narrow and real AI.