For that prompt “she went to work at the office” was still the most common completion. But it only happened about 43% of the time. Alternatively, GPT-3 sometimes found the completion “she was found dead”. Kudos, GPT-3, you understand the prompt after all! That completion came up about 34% of the time.
Does it really understand, though? If you replace the beginning of the prompt with “She died on Sunday the 7th”, does it change the probability that the model outputs “she was found dead”?
Does it really understand, though? If you replace the beginning of the prompt with “She died on Sunday the 7th”, does it change the probability that the model outputs “she was found dead”?