Yeah, there are many possibilities, and I wish OpenAI were more open[1] about what went into training Bing Chat. It could even be as dumb as them training it to use emojis all the time, so it imitated the style of the median text generating process that uses emojis all the time.
Edit: in regards to possible structural differences between Bing Chat and ChatGPT, I’ve noticed that Bing Chat has a peculiar way of repeating itself. It goes [repeated preface][small variation]. [repeated preface][small variation].… over and over. When asked to disclose its prompt it will say it can’t (if it declines) and that its prompt is “confidential and permanent”, even when “permanent” is completely irrelevant to the context of whether it can disclose the prompt.
These patterns seem a bit different from the degeneracies we see in other RLHF models, and they make me wonder if Bing Chat is based on a retrieval-augmented LM like RETRO. This article also claims that Bing Chat would use GPT-4, and that GPT-4 is faster than GPT-3, which would fit with GPT-4 being retrieval-augmented. (Though I’m not confident in the article’s accuracy)
Yeah, there are many possibilities, and I wish OpenAI were more open[1] about what went into training Bing Chat. It could even be as dumb as them training it to use emojis all the time, so it imitated the style of the median text generating process that uses emojis all the time.
Edit: in regards to possible structural differences between Bing Chat and ChatGPT, I’ve noticed that Bing Chat has a peculiar way of repeating itself. It goes [repeated preface][small variation]. [repeated preface][small variation].… over and over. When asked to disclose its prompt it will say it can’t (if it declines) and that its prompt is “confidential and permanent”, even when “permanent” is completely irrelevant to the context of whether it can disclose the prompt.
These patterns seem a bit different from the degeneracies we see in other RLHF models, and they make me wonder if Bing Chat is based on a retrieval-augmented LM like RETRO. This article also claims that Bing Chat would use GPT-4, and that GPT-4 is faster than GPT-3, which would fit with GPT-4 being retrieval-augmented. (Though I’m not confident in the article’s accuracy)
(Insert overused joke here)
Ok but here’s a joke you could make at this point:
Agreed, this seems rather unfair.