Autoplay Next video from Max length

Apache Spark and Machine Learning - Architectural and Scaling Considerations (Vartika Singh)

186 views · Published 27 September 2018 · 29:21 · Indexed 4 November 2026

Channel: Databricks · 2018 · Science & Technology

Vartika Singh has been an Applied Data Scientist for over 12 years.

How do we scale training and inference when there is ever growing amount of data in terms of size and variety to consider? Machine Learning as a problem is not independent from the data ingestion, organization and structuring issues. We walk through some lessons learnt across various data sets and verticals we commonly encounter in the wild.

To learn more: https://databricks.com/product/getting-started-guide

About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform

Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner

Apache Spark and Machine Learning - Architectural and Scaling Considerations (Vartika Singh)

More from this channel