Vincent D. Warmerdam - SaaaS - Sampling as an Algorithm Service

3,627 views · Published 13 June 2017 · 38:59 · Indexed 23 October 2026

Channel: PyData · 2017 · Science & Technology

Watch on YouTube

Filmed at PyData London 2017

Description
In this talk I will explain the idea of sampling to get to your model and I will demonstrate it with examples. The goal is to start with a for loop and to end with understanding how MCMC algorithms work.

Abstract
A lot of people understand the scikit-learn models of todays world but feel uneasy about the whole MCMC method of training. Why are these algorithms different? How is it that you don't use a gradient method but a sampler instead? It can feel a bit misterious if you've not properly been introduced to this other way of thinking.

In this talk I will explain the idea of sampling to get to your model and I will demonstrate it with examples. The goal is to start with a for loop and to end with understanding how MCMC algorithms work. As a consequence the audience will also get a proper introduction to PyMC3. In particular I will discuss the following;

why markov chain sampling can be equivalent to direct sampling
how to build your own MCMC sampler with a for loop
how this for loop can be run faster by using PyMC3 instead
the key idea of inference and how i was briefly able apply it in a santa kaggle competition
how to analyse timeseries with MCMC in PyMC3
Parts of this talk are readily available on my blog;

http://koaning.io/switching-to-sampli...
http://koaning.io/elimination-via-inf...

www.pydata.org

PyData is an educational program of NumFOCUS, a 501(c)3 non-profit organization in the United States. PyData provides a forum for the international community of users and developers of data analysis tools to share ideas and learn from each other. The global PyData network promotes discussion of best practices, new approaches, and emerging technologies for data management, processing, analytics, and visualization. PyData communities approach data science using many languages, including (but not limited to) Python, Julia, and R.

We aim to be an accessible, community-driven conference, with novice to advanced level presentations. PyData tutorials and talks bring attendees the latest project features along with cutting-edge use cases. 00:00 Welcome!
00:10 Help us add time stamps or captions to this video! See the description for details.

Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/numfocus/YouTubeVideoTimestamps

More from this channel