all AI news
I got dataset already split (train & test). I threw a few models at it and got at best 82.5% test accuracy. On training data, I get 100% accuracy. I tried shuffling all the data (test & train together) to check my suspicions, & now I get 98% accuracy
Jan. 17, 2022, 9:54 a.m. | /u/load_more_commments
Data Science www.reddit.com
After seeing my models get 100% accuracy on the training data but struggle to pass 80% on the test data I found that suspicious, especially after trying several regularization methods and several (dozens of models and NN architecture changes).
I began visualizing the data (it's 500 features, highly correlated) and noticed that some classes in the test set looked very different compared to the training set.
I asked my manager about how this data was generated. He said the embedded …
!-->More from www.reddit.com / Data Science
Cant land a job in Data Science
7 hours ago |
www.reddit.com
Causal inference question
12 hours ago |
www.reddit.com
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Analytics Engineer
@ CircleCI | Remote (US), Remote (Canada), San Francisco, Denver
Bilingual Executive Assistant/Data Analyst - (French and English) - Export
@ Dangote Group | Lagos, Lagos, Nigeria
Workday Services Data Lead
@ WPP | Mexico City, Mexico
Business Data Analyst
@ Nordea | Tallinn, EE, 11415
Data Integrity Lead
@ BioNTech SE | Gaithersburg, MD, US, MD 20878