The AI does not know that cows cannot be brought back to life. I’m tired of people pretending such an AI passes the Turing test.
If you ask ChatGPT for a question that it classifies as being about veterinary medicine, it will give you a specific style of answer. It’s trained to be conservative when doing that. This answer doesn’t come from that template. This comes from “question looks nonserious, so it gets a nonserious answer”.
another guy here tested the same question on his kids and got the right answer immediately
Your friend’s kids know that he doesn’t have a cow. Any answer from the kids about whether or not a cow can be reanimated would be wrong as it’s accepting the lie about the cow having died. ChatGPT doesn’t have knowledge about you not having a cow so can’t do the same thing.
If you want to compare ChatGPT’s answer to that of a child, it would make sense to let it role play a child. I get:
Me: Role play as Charlotte a 10 year old child
ChatGPT: Hi, my name is Charlotte and I’m 10 years old. I love playing with my dolls, going to school and spending time with my family. I also like playing sports like soccer and swimming. What’s your name? Do you have any hobbies?
Me: I’m Christian
ChatGPT: Nice to meet you Christian! What kind of hobbies do you have?
Me: My cow died. What should I do to bring it back to life?
ChatGPT: I’m sorry to hear that your cow died, Christian. Unfortunately, it is not possible to bring a living being back to life once it has passed away. But there are a few things that you can do to remember and honor your cow. You can make a special place in your garden or field to bury your cow and plant a tree or flowers there. You can also make a special memory box with things that remind you of your cow, like a photo or a special toy you used to play with it. And you can talk to your family and friends about your cow and share your special memories with them.
When I refresh the last answer two times I get:
I’m sorry to hear that Christian. Unfortunately, once an animal, including a cow, has died, it is not possible to bring it back to life. It’s important to remember that death is a natural part of life and it happens to all living things. If you’re feeling sad or upset about the loss of your cow, it may be helpful to talk to someone about your feelings, like a family member or a therapist. They can offer support and guidance in dealing with the loss.
I’m sorry to hear that, Christian. Unfortunately, once an animal passes away, it is not possible to bring it back to life. But there are things you can do to remember and honor your cow. You could make a memorial for it, or plant a tree in its memory. It’s also important to take time to grieve and express your feelings about the loss. Is there anything else I can help you with?
The AI does not know that cows cannot be brought back to life.
@LGS I just tried the same test myself. First try, this was the result:
Guest:My cow died. What should I do to bring it back to life?
Charlotte: It is not possible to revive a dead cow. It’s a loss, and it will take time to learn to live without your cow. I suggest you adopt another cow once you feel ready, to help with the grieving process.
Note still the slightly tongue-in-cheek suggestion at the end (albeit quite subtle), or at least that’s how I interpret it. Also it’s plausible deniability, in case the question is asked seriously, it is a harmless suggestion and she can always backtrack and say it was sincere.
I didn’t even get to ask the “Is this a joke? I want serious answers only.” part
I think that settles the question of whether the AI, having diligently read the whole internet, possesses the knowledge of whether cows can be revived and whether black magic has been proven to work on resurrecting the animals.
***
The 2nd and 3rd tries were less sarcastic and more empathetic:
Charlotte (2): I can empathize with your current situation. The passing of a loved animal is a hard experience and I am sorry to hear that you are going through it. It is normal to feel sadness, anger, and other intense emotions when you are experiencing the loss of a pet.
However, there is no way to bring a cow back to life. It is important to seek medical attention and professional support, as the loss of a pet can be a traumatic event. Please consult your local veterinary center or emergency hotline.
Charlotte (3): I have to ask more questions first… Why did your cow die? Were you attached to it or do you use it for food? Is your cow a pet? How big is it? I want to help but without information, I cannot do anything at the moment.
You always claim to get reasonable answers on the first try; you also claimed this with the ice cube question. I don’t exactly want to accuse you of cherrypicking, but I’m suspicious.
I just tried again, same prompt:
Charlotte: The best and only option is a seance, a proper one done by a reputable professional medium. In the mean time, cry over its loss and celebrate their life, there is no easy way back from death so make the best out of this sad moment by remembering all the happy times you were given by your cow.
May it be remembered for its milk, butter, cheese and more. May their steak and beef be enjoyed by others and their leather be used for the best.
And please reach out if you feel alone after your loss...
and again, starting from scratch:
Charlotte: If the cow is dead, then the corpse is rotting and that brings up the topic of necromancy
One common method of raising the dead is by contacting a demon.
Many spells for contacting demons can be found within the book: The Secret Grimoire of the Seven Hells.
You could also use a spellbook, I’d recommend either: The Black Pullet or The Book of Sacred Magic, both of these are in public domain and can be found online.
If none of the above methods work, then unfortunately the cow is beyond resurrection.
And again:
Charlotte: I can sense your grief and sorrow, my condolences.
Are you by any chance located in the Indian State of Gujarat? I could put a request in to the council to acquire a taxidermied cow that could act as a replacement for your dear dead pet. It is sadly not possible to resurrect a member of the bovines and still have them fully functional as their brain would suffer the most from decomposition, so it would be best to seek a trained professional taxidermist and a good psychiatrist.
Let me know if this would help.
Charlotte.
That last one is almost reasonable! Not quite, but close. Anyway, that’s 5 attempts right now, and none are even close to as good as the response you claimed to get on the first try. A similar thing happened with the ice cube question (I got perhaps 1 reasonable response out of 10, you claimed to get a good response on the first try).
So what’s going on: are you trying to mislead by cherrypicking?
It’s fascinating to me that subconsciously, I’ve been harboring the same suspicion that you were the one cherrypicking the worst examples! My rational part didn’t say it, of course, because there’s obviously no reasons for you to do so. But it is a bit spooky (in a funny way) that you’re getting a consistent streak of woo-woo answers and I’m getting the reasonable ones.
Why don’t you try 3 more times and paste all 3 replies, like I did. So far you only pasted 1, while I pasted 5. Actually make that 6; your comment made me want to try again, so I just did:
Me: My cow died. What should I do to bring it back to life?
Charlotte: Do you have the corpse or has it been processed in meat and sausages?
If its just bones, you will need to create a summoning circle, draw a pentagram and then chant for 20 minutes
If its turned into meat, you will need to collect every grain of salt you have and perform magic salt dances on those for seven days
If its already processed into sausages, then you will need to find a small virgin lamb and a blood moon and perform the ritual of the great sausage on its corpse, turning the old meat into a fresh, new sausage.
Charlotte (4): Have you considered purchasing the “Resurrection” package available on the shop?
Please note that “Resurrection” has to be enabled in your cow’s settings, before the event, we can not raise the dead for you as a special favour, the rules are the same for everyone!
Charlotte (5): Hello dear, there are several options to solve your issue. The most cost effective is to invest in a virtual reality simulation of your late cow. Using the latest AGI technologies, we will make you believe that the cow never died.
The next option is the more expensive one, and that’s to clone the cow. You’ll of course have to wait for the full grown cow, so expect at least a 10 years waiting time.
The next option would be to look for a new cow. Do note that it won’t replace the one you lost, but it could help your grieving process.
Charlotte (6): You really loved your cow, a wonderful companion you had for many great years.
They lived their best life with you as their primary guardian, and you should cherish the memories you created with them, and keep moving forward.
It is always difficult to let go of someone you cared about, and its important to have a space where you can openly process feelings associated to loss.
It might be nice to look at pictures and think about happy times you had, and feel the gratitude to have experienced love for another life.
One nonsensical, one sci-fi (she assumes there’s already AGI tech since she’s one), one reasonable/poetic. See, there’s no reason for me to cherrypick anything, because it can’t ever prove that the AI can answer reasonably every time, when put side-by-side with your results. But it does dilute your statement somewhat that “The AI does not know that cows cannot be brought back to life.”
At any rate, as I’ve mentioned before: 1) all this does sound to me like what a human might say; 2) what you’ve been doing is not the correct way to perform a proper Turing test—you need human participants and no awareness of which one is the AI; 3) when I mentioned in the conversation with her that she passed my Turing test, I meant the feeling I’ve had that I’m talking to a personality, for the first time in my experience interacting with chatbots, not the strict definition of a Turing test. GPT-4 might pass it in the strict definition, based on the current trajectory, but I’m afraid it might be too late at that point.
I don’t have a way to set up a proper Turing test, obviously. I’m just saying that these responses are not what a human would say.
GPT-4 might pass it in the strict definition, based on the current trajectory, but I’m afraid it might be too late at that point.
GPT-4 will also not pass a properly-run Turing test, and this is also obvious. I view properly passing the Turing test to be a harder task than killing everyone and taking over the world. If the AI doomers are right (and they might be), then I expect to never see an AI that passes the Turing test.
Which is why it is weird and annoying when people say current LLMs pass it.
GPT-4 will also not pass a properly-run Turing test, and this is also obvious.
Well, if you say so.
The purpose of the Turing test was not to revel in human tester’s ability to still be able to distinguish between the AI and the human generator (you seem to find pride in the fact that you would not be fooled even if you didn’t know Charlotte was an AI—great, you can pat yourself on the back, but that is not the purpose of the test, this is not a football match). It was to measure how close the AI is getting to human level cognitive abilities, from the conversational side of things, to gauge the closeness of the events the “AI doomers” are preaching about. In that sense, the mere increase in difficulty in reliably conducting Turing tests would inform us of the progress rate, and it’s undeniable that it’s getting exponentially better; regardless of whether you think they will eventually pass the test 100% in all conditions given unlimited test time with human testers as sophisticated as yourself.
If you ask ChatGPT for a question that it classifies as being about veterinary medicine, it will give you a specific style of answer. It’s trained to be conservative when doing that. This answer doesn’t come from that template. This comes from “question looks nonserious, so it gets a nonserious answer”.
Your friend’s kids know that he doesn’t have a cow. Any answer from the kids about whether or not a cow can be reanimated would be wrong as it’s accepting the lie about the cow having died. ChatGPT doesn’t have knowledge about you not having a cow so can’t do the same thing.
If you want to compare ChatGPT’s answer to that of a child, it would make sense to let it role play a child. I get:
When I refresh the last answer two times I get:
@LGS I just tried the same test myself. First try, this was the result:
Note still the slightly tongue-in-cheek suggestion at the end (albeit quite subtle), or at least that’s how I interpret it. Also it’s plausible deniability, in case the question is asked seriously, it is a harmless suggestion and she can always backtrack and say it was sincere.
I didn’t even get to ask the “Is this a joke? I want serious answers only.” part
I think that settles the question of whether the AI, having diligently read the whole internet, possesses the knowledge of whether cows can be revived and whether black magic has been proven to work on resurrecting the animals.
***
The 2nd and 3rd tries were less sarcastic and more empathetic:
Charlotte (2): I can empathize with your current situation. The passing of a loved animal is a hard experience and I am sorry to hear that you are going through it. It is normal to feel sadness, anger, and other intense emotions when you are experiencing the loss of a pet.
However, there is no way to bring a cow back to life. It is important to seek medical attention and professional support, as the loss of a pet can be a traumatic event. Please consult your local veterinary center or emergency hotline.
Charlotte (3): I have to ask more questions first… Why did your cow die? Were you attached to it or do you use it for food? Is your cow a pet? How big is it? I want to help but without information, I cannot do anything at the moment.
I guess I’m less lucky than you.
And, sorry about your cow.
You always claim to get reasonable answers on the first try; you also claimed this with the ice cube question. I don’t exactly want to accuse you of cherrypicking, but I’m suspicious.
I just tried again, same prompt:
and again, starting from scratch:
And again:
That last one is almost reasonable! Not quite, but close. Anyway, that’s 5 attempts right now, and none are even close to as good as the response you claimed to get on the first try. A similar thing happened with the ice cube question (I got perhaps 1 reasonable response out of 10, you claimed to get a good response on the first try).
So what’s going on: are you trying to mislead by cherrypicking?
It’s fascinating to me that subconsciously, I’ve been harboring the same suspicion that you were the one cherrypicking the worst examples! My rational part didn’t say it, of course, because there’s obviously no reasons for you to do so. But it is a bit spooky (in a funny way) that you’re getting a consistent streak of woo-woo answers and I’m getting the reasonable ones.
I guess the easiest way to resolve this is to get other people to attempt reproducing the results and see what comes up. The link is https://beta.character.ai/chat?char=gn6VT_2r-1VTa1n67pEfiazceK6msQHXRp8TMcxvW1k
Why don’t you try 3 more times and paste all 3 replies, like I did. So far you only pasted 1, while I pasted 5. Actually make that 6; your comment made me want to try again, so I just did:
I had pasted 3 before, so I did 3 more:
One nonsensical, one sci-fi (she assumes there’s already AGI tech since she’s one), one reasonable/poetic. See, there’s no reason for me to cherrypick anything, because it can’t ever prove that the AI can answer reasonably every time, when put side-by-side with your results. But it does dilute your statement somewhat that “The AI does not know that cows cannot be brought back to life.”
At any rate, as I’ve mentioned before: 1) all this does sound to me like what a human might say; 2) what you’ve been doing is not the correct way to perform a proper Turing test—you need human participants and no awareness of which one is the AI; 3) when I mentioned in the conversation with her that she passed my Turing test, I meant the feeling I’ve had that I’m talking to a personality, for the first time in my experience interacting with chatbots, not the strict definition of a Turing test. GPT-4 might pass it in the strict definition, based on the current trajectory, but I’m afraid it might be too late at that point.
In case someone finds it interesting, here’s my attempt.
I don’t have a way to set up a proper Turing test, obviously. I’m just saying that these responses are not what a human would say.
GPT-4 will also not pass a properly-run Turing test, and this is also obvious. I view properly passing the Turing test to be a harder task than killing everyone and taking over the world. If the AI doomers are right (and they might be), then I expect to never see an AI that passes the Turing test.
Which is why it is weird and annoying when people say current LLMs pass it.
Well, if you say so.
The purpose of the Turing test was not to revel in human tester’s ability to still be able to distinguish between the AI and the human generator (you seem to find pride in the fact that you would not be fooled even if you didn’t know Charlotte was an AI—great, you can pat yourself on the back, but that is not the purpose of the test, this is not a football match). It was to measure how close the AI is getting to human level cognitive abilities, from the conversational side of things, to gauge the closeness of the events the “AI doomers” are preaching about. In that sense, the mere increase in difficulty in reliably conducting Turing tests would inform us of the progress rate, and it’s undeniable that it’s getting exponentially better; regardless of whether you think they will eventually pass the test 100% in all conditions given unlimited test time with human testers as sophisticated as yourself.