nit: inference is not zero marginal cost. statement seems to be importing intuitions from traditional software which do not necessarily transfer. let me know if I misunderstood or am confused.
I think people just say “zero marginal cost” in this context to refer to very low marginal cost. I agree that inference isn’t actually that low cost though. (Certainly much higher than the cost of distributing/serving software.)
nit: inference is not zero marginal cost. statement seems to be importing intuitions from traditional software which do not necessarily transfer. let me know if I misunderstood or am confused.
I think people just say “zero marginal cost” in this context to refer to very low marginal cost. I agree that inference isn’t actually that low cost though. (Certainly much higher than the cost of distributing/serving software.)