Demistifying Inference after Adaptive Experiments

arXiv:2405.01281v1 Announce Type: cross
Abstract: Adaptive experiments such as multi-arm bandits adapt the treatment-allocation policy and/or the decision to stop the experiment to the data observed so far. This has the potential to improve outcomes for study participants within the experiment, to improve the chance of identifying best treatments after the experiment, and to avoid wasting data. Seen as an experiment (rather than just a continually optimizing system) it is still desirable to draw statistical inferences with frequentist guarantees. The …

abstract adapt arm arxiv chance data decision econ.em experiment inference math.st policy stat.me stat.ml stat.th study treatment type