Does GPT-4 seem better than Bing’s AI (which also uses some form of GPT-4) to anyone else? This is hard to quantify, but I notice Bing misunderstanding complicated prompts or making mistakes in ways GPT-4 seems better at avoiding.
The search requests it makes are sometimes too simple for an in-depth question and because of this, its answers miss the crux of what I’m asking. Am I off base or has anyone else noticed this?
AFAIK, no information regarding this has been publicly released. If my assumption that Bing’s AI is somehow worse than GPT-4 is true, then I suspect some combination of three possible explanations must be true:
To save on inference costs, Bing’s AI uses less compute.
Bing’s AI simply isn’t that well trained when it comes to searching the web and thus isn’t using the tool as effectively as it could with better training.
Bing’s AI is trained to be sparing with searches to save on search costs.For multi-part questions, Bing seems too conservative when it comes to searching. Willingness to make more queries would probably improve its answers but at a higher cost to Microsoft.
Does GPT-4 seem better than Bing’s AI (which also uses some form of GPT-4) to anyone else? This is hard to quantify, but I notice Bing misunderstanding complicated prompts or making mistakes in ways GPT-4 seems better at avoiding.
The search requests it makes are sometimes too simple for an in-depth question and because of this, its answers miss the crux of what I’m asking. Am I off base or has anyone else noticed this?
It does seem plausible that bing chat got to use OpenAI’s base gpt-4 model, but not its RLHF finetuning infrastructure.
Do we know whether both use the same amount of compute?
AFAIK, no information regarding this has been publicly released. If my assumption that Bing’s AI is somehow worse than GPT-4 is true, then I suspect some combination of three possible explanations must be true:
To save on inference costs, Bing’s AI uses less compute.
Bing’s AI simply isn’t that well trained when it comes to searching the web and thus isn’t using the tool as effectively as it could with better training.
Bing’s AI is trained to be sparing with searches to save on search costs.For multi-part questions, Bing seems too conservative when it comes to searching. Willingness to make more queries would probably improve its answers but at a higher cost to Microsoft.