Google won’t be able to sell outside of their cloud offering, as they don’t have the experience in selling hardware to enterprise. Their cloud offering is also struggling against Azure and AWS, ranking 1⁄5 of the yearly revenues of those two. I am not saying Nvidia won’t have competition, but they seem enough ahead right now that they are the prime candidate to have the most benefits from a rush into compute hardware.
They seem focused on inferencing, which requires a lot less compute than training a model. Example: GPT-3 required thousands of GPUs for training, but it can run on less than 20 GPUs.
There will be models trained with a lot more compute then GPT-3 and the best models that are out there will be build on those huge billion dollar models. Renting out those billion dollar models in a software as a service way makes sense as a business model. The big cloud providers will all do it.
With big cloud providers like Google building their own chips there are more players then just the startups and Nvidia.
Google won’t be able to sell outside of their cloud offering, as they don’t have the experience in selling hardware to enterprise. Their cloud offering is also struggling against Azure and AWS, ranking 1⁄5 of the yearly revenues of those two. I am not saying Nvidia won’t have competition, but they seem enough ahead right now that they are the prime candidate to have the most benefits from a rush into compute hardware.
Microsoft and Amazon also have projects that are about producing their own chips.
Given the way the GPT architecture works, AI might be very much centered in the cloud.
They seem focused on inferencing, which requires a lot less compute than training a model. Example: GPT-3 required thousands of GPUs for training, but it can run on less than 20 GPUs.
Microsoft built an Azure supercluster for OpenAI and it has 10,000 GPUs.
There will be models trained with a lot more compute then GPT-3 and the best models that are out there will be build on those huge billion dollar models. Renting out those billion dollar models in a software as a service way makes sense as a business model. The big cloud providers will all do it.