Improve Your A/B Tests with 9 Lessons from the COVID-19 Vaccine Trials

A full year has passed since results from the first clinical trials of COVID-19 vaccines became available. Vast swaths of follow-up observational data are now in circulation which enables some conclusions about the strengths and weaknesses of those trials. Since modern medical trials are among the most rigorous and scrutinized experiments they can serve as a case study with applications to online experiments with which they share more similarities than may be apparent. …

a-b-testing covid covid-19 data science statistical-analysis statistics vaccine