Design Principles for Falsifiable, Replicable and Reproducible Empirical ML Research

arXiv:2405.18077v1 Announce Type: new
Abstract: Empirical research plays a fundamental role in the machine learning domain. At the heart of impactful empirical research lies the development of clear research hypotheses, which then shape the design of experiments. The execution of experiments must be carried out with precision to ensure reliable results, followed by statistical analysis to interpret these outcomes. This process is key to either supporting or refuting initial hypotheses. Despite its importance, there is a high variability in research …

abstract arxiv clear cs.ai cs.lg design development domain fundamental heart lies machine machine learning ml research precision research role shape type