Sample Ratio Mismatch: So many questions. How to answer them?

Nothing deflates an A/B testing program quicker than data validation issues — and SRM is one of the most damaging. But how accurate is testing for SRM anyway?

Suppose you have an A/B test where you expected a 50/50 split of users in each test group. Instead, the Control and Variation groups are off by around 7%. You have a total of 8,000 users assigned to the experiment.

Should we stop the test? I mean, how …

a/b testing analytics conversion-optimization data science experimentation