Bayesian AB Testing#

I talk about the Bayesian approach to AB testing. The approach consists of 3 steps: making a hypothesis about the experiment, understanding time and data constraints, and interpreting the results after collecting the data. The advantage is that the Bayesian AB(C) test does not require p-values, corrections or bootstrap procedures, is conservative (does not exaggerate the result on small data) and is easily interpreted for business.

../../../_images/cover.jpeg

Video#

Materials#

Bayesian inference at scale: Running A/B tests with millions of observations   The R2D2M2 Prior, the Awwwesome Linear Regression