This might be a more promising approach—testing the computer on novel (math or other) problems expressed in natural language. Of course, they’d have to be truly novel, each and every time...
I don’t think there are many novel math problems that are easy enough that you don’t falsely label people as chatbots when they say they don’t know how to do it. If you let people make maybe promising sounding solutions, that opens up a cheating mechanism for the AI to fool you back, by making mushy statements related to the topic.
Why not test its ability to negotiate and trade, as well as to improvise in human behavior? If it can write you a poem for some money, then invest that money in the stock market, and later use the resulting fortune to benefit itself (an upgrade, perhaps?), then you’re probably dealing with an intelligent being, no? Bonus points if it studies other methods of succeeding, and is willing to benefit other intelligent beings.
Definitely. Hence do it!
This might be a more promising approach—testing the computer on novel (math or other) problems expressed in natural language. Of course, they’d have to be truly novel, each and every time...
I don’t think there are many novel math problems that are easy enough that you don’t falsely label people as chatbots when they say they don’t know how to do it. If you let people make maybe promising sounding solutions, that opens up a cheating mechanism for the AI to fool you back, by making mushy statements related to the topic.
Math problems are one thing, “problems” expressed in natural language are both easier to invent and (if you’re human) solve, I should think.
Also, math problems don’t seem GAI complete, yeah, especially if you’re dealing with an “average” human player.
Why not test its ability to negotiate and trade, as well as to improvise in human behavior? If it can write you a poem for some money, then invest that money in the stock market, and later use the resulting fortune to benefit itself (an upgrade, perhaps?), then you’re probably dealing with an intelligent being, no? Bonus points if it studies other methods of succeeding, and is willing to benefit other intelligent beings.