May 30, 2022, 6:49 p.m. | Frederic Marthoz

Towards Data Science - Medium towardsdatascience.com

A Quick-Start Guide to A/B Testing

A step-by-step approach to finding valuable insights

Photo by Braden Collum on Unsplash

Introduction

So you’ve been tasked to set up a marketing A/B test and don’t have a lot of time to figure things out. Here is a quick start guide on how to do it when the main metric to improve is a proportion: click-through rate, conversion rate, open rate, reply rate…

1. Define your null hypothesis and choose your significance level …

a-b-testing a/b testing b testing data science experiment statistical-power statistics testing

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne