July 26, 2023, 3:10 a.m. | /u/Aardvark_analyst

Data Science www.reddit.com

I've noticed some departments in my company always report every single A/B test as succeeding and driving an additional $X revenue. I've managed A/B testing frameworks in the past, and it's highly unlikely every single test is a success. Some are flat. Some show a worse outcome. That's why you test. I've been here a few years now and have yet to see any test from this department either coming in flat or underperforming the control.

Also, their results aren't …

a/b testing b testing datascience driving experience frameworks managed report revenue show success test testing

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

DevOps Engineer (Data Team)

@ Reward Gateway | Sofia/Plovdiv