Web: http://arxiv.org/abs/2201.10770

Jan. 27, 2022, 2:10 a.m. | Min Woo Sun, Robert Tibshirani

stat.ML updates on arXiv.org arxiv.org

Cross-validation (CV) is one of the most widely used techniques in
statistical learning for estimating the test error of a model, but its behavior
is not yet fully understood. It has been shown that standard confidence
intervals for test error using estimates from CV may have coverage below
nominal levels. This phenomenon occurs because each sample is used in both the
training and testing procedures during CV and as a result, the CV estimates of
the errors become correlated. Without …

arxiv confidence cross model test validation

Data Analyst, Credit Risk

@ Stripe | US Remote

Senior Data Engineer

@ Snyk | Cluj, Romania, or Remote

Senior Software Engineer (C++), Autonomy Visualization

@ Nuro, Inc. | Mountain View, California (HQ)

Machine Learning Intern (January 2023)

@ Cohere | Toronto, Palo Alto, San Francisco, London

Senior Machine Learning Engineer, Reinforcement Learning, Personalization

@ Spotify | New York, NY

AWS Data Engineer

@ ProCogia | Seattle