Confidence level

Confidence level: A confidence level refers to the statistical measure in an A/B test that provides an assurance or degree of certainty about the reliability of the result. For example, a 95% confidence level means that the likelihood of the observed difference between two versions has a 95% chance of being accurate, and is not due to random chance. Higher confidence levels reduce the probability of false positives in experiments.