OpenAI appears to be really struggling with inference costs—according to this article they should be continually retraining GPT 4 to reduce inference costs for the deployed model.
And they are, as best as anyone can tell.
And they are, as best as anyone can tell.