False positive

A False positive is an experiment that we thought was beneficial, but wasn’t. For example, if the default winning threshold is 95%, it’s a given that 5% of the time we will be wrong.