Martin Goodson - Most Winning A/B Test Results are Illusory
3,182 views · Published 3 April 2014 · 35:01 · Indexed 27 September 2026
Channel: PyData · 2014 · People & Blogs
http://www.slideshare.net/PyData/py-data-goodson-mostabtestingresultsareillsory Many people have started to suspect that their A/B testing results are not what they seem. A/B test reports an uplift of 20% and yet this increase never seems to translate into increased profits. So what's going on? I'll use python simulations to show that A/B testing is often conducted in such a way that it virtually guarantees false positive results. I'll also mention some python functions that can be used to avoid these problems. 00:00 Welcome! 00:10 Help us add time stamps or captions to this video! See the description for details. Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/numfocus/YouTubeVideoTimestamps
More from this channel
-
44:17
Jonny Edwards - Recommenders in Python
-
41:31
Jacob Barhak - The Reference Model for Disease Progression
-
1:14:06
Travis Oliphant - Packaging and Deployment
-
24:26
Olga Botvinnik - Data Driven Conversations About Biology
-
25:10
Hugo Shi - KitchenSink Framework for Working with Remote Datasets Interactively
-
29:08
Daniel Blanchard - Simple Machine Learning with SKLL 1.0
-
42:59
Michelle Fullwood - Grids, Streets & Pipelines: Making a linguistic streetmap with scikit-learn
-
48:48
Matthew Rocklin: pyData Berlin 2015: keynote