(I don’t know anyone at all who is training a system with more compute than GPT-4, other than OpenAI.)
I don’t think we heard anything about e.g. PaLM, PaLM-E, Chinchilla or Gopher before the respective papers came out? (PaLM-E might already be “more powerful” than GPT-4, depending on how you define “more powerful”, since it could act as a multimodal language model like GPT-4 and control a robot on top.) Probably several organizations are working on something better than GPT-4, they just have no reason to talk about their progress before they have something that’s ready to show.
I don’t think we heard anything about e.g. PaLM, PaLM-E, Chinchilla or Gopher before the respective papers came out? (PaLM-E might already be “more powerful” than GPT-4, depending on how you define “more powerful”, since it could act as a multimodal language model like GPT-4 and control a robot on top.) Probably several organizations are working on something better than GPT-4, they just have no reason to talk about their progress before they have something that’s ready to show.