Look Who it Was Random video

PyData Ann Arbor: Daniel Whitenack | Scalable, Distributed, and Reproducible Machine Learning

1,513 views · Published 30 May 2017 · 1:27:12 · Indexed 29 October 2026

Channel: PyData · 2017 · Science & Technology

Watch on YouTube

PyData Ann Arbor Meetup - May 25, 2017
Sponsored by NumFOCUS, TD Ameritrade, and MIDAS
https://www.meetup.com/PyData-Ann-Arbor/

Daniel Whitenack | Scalable, Distributed, and Reproducible Machine Learning

The recent advances in machine learning and artificial intelligence are amazing!  Yet, in order to have real value within a company, data scientists must be able to get their models off of their laptops and deployed within a company’s data pipelines and infrastructure.  Those models must also scale to production size data. In this talk, we will implement a model locally in Python. We will then take that model and deploy both it's training and inference in a scalable manner to a production cluster with Pachyderm, an open source framework for distributed pipelining and data versioning. We will also learn how to update the production model online, track changes in our model and data, and explore our results. 

Daniel Whitenack (@dwhitena) is a Ph.D. trained data scientist working with Pachyderm (@pachydermIO). Daniel develops innovative, distributed data pipelines which include predictive models, data visualizations, statistical analyses, and more. He has spoken at conferences around the world (ODSC, Spark Summit, Datapalooza, DevFest Siberia, GopherCon, and more), teaches data science/engineering with Ardan Labs (@ardanlabs), maintains the Go kernel for Jupyter, and is actively helping to organize contributions to various open source data science projects. 00:00 Welcome!
00:10 Help us add time stamps or captions to this video! See the description for details.

Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/numfocus/YouTubeVideoTimestamps

More from this channel