Dec 19 2007
The bad science of A/B and multivariate testing for e-commerce
Direct marketers refined the science of A/B testing 50 years ago and we need to pay attention to lessons they have learned. Unless you are controlling the demographics of your samples, the absolute minimum sample size is 5M per segment with 20M to 25M being the standard.