Power

The Power of a test refers to how efficiently it can detect true uplift. We would like this to be as high as possible, but the trade-off is that high-powered tests require more data. For a standard test, we’ve set our parameters so that a variant with an actual 5% uplift has an 80% chance of winning the test.