Measure A/B Testing Platform Health with Simulated A/A and A/B Tests

How we ensure the reliability of our A/B testing platform with simulations

Contributors: Max Li, Eric Jia

A/B testing plays a critical role in decision-making in data-driven companies. It is typically the final say of go or no-go for a new product design, business strategy, machine learning model, etc. Inaccuracies in the A/B testing platform degrade all business decisions derived from A/B tests. In this article, we share our methodology that continuously evaluates …

a-b-testing a/b testing b testing data science experimentation health platform reliability statistics testing tests