Feb. 15, 2024, 5:34 p.m. | /u/slimsippin

Data Science www.reddit.com

I have experience in academia and from reading but not in industry. I only seen label shift during my internship but my internship ended before I could understand what was causing the positive label proportion to decline.

How do you folks in industry do root cause analysis of model performance decline? Is there some framework you use? How do you know when to retrain a model vs when there’s a bug in the pipeline? Any framework here would help truly …

academia analysis datascience experience industry internship people performance positive reading root cause analysis shift

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Machine Learning Engineer

@ Apple | Sunnyvale, California, United States