In the case of OpenAI, the server-side-only constraint, IIRC, is intentional, to prevent people from modifying the model, for AI safety reasons. My understanding is that usually running a model isn’t as compute-intensive as training it in the first place, so I’d expect a user-side application to be viable; just not in line with OpenAI’s modus operandi.
In the case of OpenAI, the server-side-only constraint, IIRC, is intentional, to prevent people from modifying the model, for AI safety reasons. My understanding is that usually running a model isn’t as compute-intensive as training it in the first place, so I’d expect a user-side application to be viable; just not in line with OpenAI’s modus operandi.