Sept. 5, 2022, 7:22 a.m. | /u/Fendrbud

Data Science www.reddit.com

I am having a bit of a hard time understanding the correct way to test and run my binary classification model in holdout set/production when it's trained based on preprocessed data. I currently have a pipeline looking something link this:

https://preview.redd.it/4av5tosqrzl91.png?width=1588&format=png&auto=webp&s=f193dff18b56abdfdd4dcab635a046ba26659eb0

And now I want to test my trained model on the holdout validation set. I'm saving both the one-hot and ordinal encoders as pickle files such that I can reuse them on the holdout test set. However, I'm experiencing …

data data pipeline datascience ordinal pipeline set testing

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Senior Software Engineer, Generative AI (C++)

@ SoundHound Inc. | Toronto, Canada