4 years ago

AB testing is easy to understand and hard to master. But you can easily get lost in a sea of definitions and poorly set up tests and hard to interpret results.

It is defined by the sample size (Visitors on control and treatment are each a sample) and the variation of the groups (the more similar they are, the better).

Google Optimize will calculate the expected goal (in our case the conversion) and the probability that the treatment will beat the original. This is an example result from a test where the treatment beat the original: Martin Betz, 2020 • Privacy/GDPR • Imprint