NannyML — OSS Python library for detecting silent ML model failure

“
Hey Everyone! I am Hakim, co-founder of NannyML.

Early in my data science career, I developed the intuition that machine learning models are dynamic systems. You set performance metrics, train them on historical data, put them out into the real world to make decisions, and then the real-world changes.

So what happens to these models and their performance?

For the most part, we have no idea.

There is no way to measure the performance of most machine learning models …

failure library ml oss python