Preparing for the test
- Choose primary and secondary metrics.
- Choose test power (1 - beta). Usually it’s 0.8
- Choose significance level (alpha). Usually it’s 0.05
- Obtain existing mean value (mean 1 or mu1) from historical data
- Chose MEI and calculate mean 2 (mu2)
- Calculate sample size using stats calculator
- Based on sample size calculate test duration