A/A Testing Establishes Trust in Experimentation Platform

How We Ensure the Reliability of Our Experimentation Platform with Various A/A Tests

Contributors: Max Li, Chao Qi

Imagine the false positive rate of your A/B testing platform was as high as 50%. You may as well abandon the A/B testing completely and start flipping coins to make your product launch decisions. A false-positive rate higher than 50% is not impossible. While developing our percentile metrics testing, we used an A/A test …

a-b-testing data science ecommerce experimentation platform testing trust