I just tried out a random sentence, inspired by true events, with Bing Chat
reverse the following string, character by character: My tan and white cat ate too much kibble and threw up in my brand new Nikes.
to which Bing Chat replied
Here is the reversed string, character by character: sekilb kcuom oot eta tac etihw dna nat ynat yM .sekilb wen dnarb ym ni pu wohs ti ekilb yM
I think it did understand the task, because when I asked it again this happened:
can you reverse the following string: sekilb kcuom oot eta tac etihw dna nat ynat yM .sekilb wen dnarb ym ni pu wohs ti ekilb yM
Sent message. can you reverse the following string: sekilb kcuom oot eta tac etihw dna nat ynat yM .sekilb wen dnarb ym ni pu wohs ti ekilb yM
Sure! Here is the reversed string: My brand new Nikes in up pu ni ym bradn wen kibble ti wohs up ni tac eta too muhc etac eht dna nat ynaM
I’d be curious to see what the results are with GPT-4 proper, but not curious enough to sign up for a $20 / month subscription. Anyone with a subscription want to take a crack at it?
I tried it on “Precise” and it’s close but not perfect, which leads me to believe that it has actually learned the task rather than using some sort of subroutine.
Prompt: reverse the following string, character by character: My tan and white cat ate too much kibble and threw up in my brand new Nikes.
Response: Here is the reversed string: sekNi wen dnarb ym ni pu wuorht dna elbbik hcum oot eta tac etihw dna nat yM
Reversing this response, we can see there are two mistakes: My tan and white cat ate too much kibble and throuw up in my brand new iNkes
I’ve tried this with Bing chat and it works fine with zero shot.
Prompt: Reverse the following string: “god yzal eht revo depmuj xof nworb kciuq ehT”
Response: Sure! Here’s the reversed string: “The quick brown fox jumped over the lazy dog”
Note that this is not identical to the original three prompts, which worked in the opposite direction.
I just tried out a random sentence, inspired by true events, with Bing Chat
to which Bing Chat replied
I think it did understand the task, because when I asked it again this happened:
I’d be curious to see what the results are with GPT-4 proper, but not curious enough to sign up for a $20 / month subscription. Anyone with a subscription want to take a crack at it?
ChatGPT-4 gets it right.
Prompt: Reverse the following string, character by character: My tan and white cat ate too much kibble and threw up in my brand new Nikes.
GPT-4:
I tried it on “Precise” and it’s close but not perfect, which leads me to believe that it has actually learned the task rather than using some sort of subroutine.
Prompt:
reverse the following string, character by character: My tan and white cat ate too much kibble and threw up in my brand new Nikes.
Response:
Here is the reversed string: sekNi wen dnarb ym ni pu wuorht dna elbbik hcum oot eta tac etihw dna nat yM
Reversing this response, we can see there are two mistakes:
My tan and white cat ate too much kibble and thr
ouw up in my brand newiNkes