It would be interesting to evaluate RETRO as it works differently from all the models we’ve evaluated. WebGPT is finetuned to use a search engine and it uses this (at inference time) to answer questions. This seems more powerful than the retrieval system for RETRO (based on a simple nearest neighbor lookup). So my speculation is that WebGPT would do better.
We don’t have plans to evaluate it but are open to the possibility (if the RETRO team was interested).
It would be interesting to evaluate RETRO as it works differently from all the models we’ve evaluated. WebGPT is finetuned to use a search engine and it uses this (at inference time) to answer questions. This seems more powerful than the retrieval system for RETRO (based on a simple nearest neighbor lookup). So my speculation is that WebGPT would do better.
We don’t have plans to evaluate it but are open to the possibility (if the RETRO team was interested).