Look Who it Was Random video

PyData Tel Aviv Meetup: Exploiting large datasets for multi-class classification - Victor Makarenkov

1,049 views · Published 14 May 2017 · 36:14 · Indexed 10 November 2026

Channel: PyData · 2017 · Science & Technology

Watch on YouTube

PyData Tel Aviv Meetup: Victor Makarenkov | Easy Spark: Exploiting large datasets for multi-class classification

PyData Tel Aviv Meetup #3
5 April 2017
Sponsored and hosted by Taboola
https://www.meetup.com/PyData-Tel-Aviv/

Apache Spark provides an interface for programming entire clusters with implicit data parallelism and fault tolerance. At first glance, it seems that getting started with programming the Hadoop eco-system is quite cumbersome, and not so user-friendly for a data scientist or a machine learning specialist. In this talk I will briefly introduce Apache Spark, and its programming paradigm. I will show how to easily execute a distributed training of the common multi-class classifiers (naïve Bayes, random forest, logistic regression), without installing a single virtual machine, virtual box or a docker. I will share my experience of managing long-term software projects which are based on the Hadoop technology for data storage, extraction and transformation.
Code: https://github.com/vicmak/Mining-Massive-Datasets

--
www.pydata.org

PyData brings together both users and developers of data analysis tools to share ideas and learn from each other. The goals are to provide data science enthusiasts, across various domains, a place to discuss how best to apply languages and tools to the challenges of data management, processing, analytics, and visualization.

PyData is organized by NumFOCUS, a 501(c)(3) charity in the United States. www.numfocus.org 00:00 Welcome!
00:10 Help us add time stamps or captions to this video! See the description for details.

Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/numfocus/YouTubeVideoTimestamps

More from this channel