ML Troubleshooting Is Too Hard Today (But It Doesn’t Have To Be That Way)

Evolution of ML monitoring (image by author)

ML Troubleshooting Is Too Hard Today (But It Doesn’t Have to Be That Way)

As ML practitioners deploy more models into production, the stakes for model performance are higher than ever — and the mistakes costlier.

Part One: From No Monitoring to Monitoring

To paraphrase a common bit of wisdom, if a machine learning model runs in production and no one is complaining, does it mean the model is perfect? The unfortunate truth …

machine learning ml ml-observability model-monitoring notes-from-industry troubleshooting