What part is scary? I think they’re missing out on the sheer variety of model usage—probably as variable as software deployments. But I don’t think there’s anything particularly scary about any given point on the curve.
Some really do get built, validated, and deployed twice a year. Some have CI pipelines that re-train with new data and re-validate every few minutes. Some are self-updating, and re-sync to a clean state periodically. Some are running continuous a/b tests of many candidate models, picking the best-performer for a customer segment every few minutes, and adding/removing models from the pool many times per day.
What part is scary? I think they’re missing out on the sheer variety of model usage—probably as variable as software deployments. But I don’t think there’s anything particularly scary about any given point on the curve.
Some really do get built, validated, and deployed twice a year. Some have CI pipelines that re-train with new data and re-validate every few minutes. Some are self-updating, and re-sync to a clean state periodically. Some are running continuous a/b tests of many candidate models, picking the best-performer for a customer segment every few minutes, and adding/removing models from the pool many times per day.