Common Mistakes During A/B Testing

Our path to excellence is paved with mistakes. Let’s make them!

During the last couple of years, I have witnessed a lot of mistakes that people make during A/B testing design and post-analysis. I would like to discuss here three of such mistakes and how to overcome them.

Use Mann-Whitney for comparing medians

The first mistake is not an appropriate use of Mann-Whitney test.The method is massively misunderstood and misused, because most people use this test ,assuming that it is …

a-b-testing a/b testing b testing data science machine learning mathematics mistakes statistics testing