Oct. 22, 2022, 4:13 a.m. | Georgi Georgiev

Towards Data Science - Medium towardsdatascience.com

A meta-analysis with insights into test duration, sample size, lift, power, confidence thresholds, and the performance of sequential tests

Photo by Luke Chesser on Unsplash

How long does a typical A/B test run for? What percentage of A/B tests result in a ‘winner’? What is the average lift achieved in online controlled experiments? How good are top conversion rate optimization specialists at coming up with impactful interventions for websites and mobile apps?

This meta-analysis of 1,001 A/B tests analyzed using …

a-b-testing conversion-optimization notes-from-industry statistical-analysis statistics tests

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Business Intelligence Manager

@ Sanofi | Budapest

Principal Engineer, Data (Hybrid)

@ Homebase | Toronto, Ontario, Canada