Accelerating Apache Spark for Intelligent Edge Applications with Yaron Haviv (iguazio)
890 views · Published 11 October 2018 · 34:07 · Indexed 14 November 2026
Channel: Databricks · 2018 · Science & Technology
AI is shifting from batch processes to real-time, event-driven applications, requiring companies to process data at the edge of the network near the data sources. Edge data sources can be anything from a car, or wristwatch, to an industrial component gathering data from multiple machines in a factory. Yaron Haviv will walk you through interactively developing AI applications with Spark ML and Spark streaming which run on hybrid environments, leveraging elasticity in the cloud and high performance at the edge. He will explain how to leverage Spark’s extensive set of AI tools and ability to process large data sets to create machine learning models in the public cloud, and seamlessly deploy them at the edge for immediate action. Furthermore, participants will learn how to ensure models are constantly updated across cloud and edge and how to rapidly send sensor data from the edge to the cloud. The session will include live IIoT demos of real-world customer use-cases such as detection of patterns in historical data sets to learn about machinery, predict outcomes and make correlations with real-time fresh data. About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business. Read more here: https://databricks.com/product/unified-data-analytics-platform Connect with us: Website: https://databricks.com Facebook: https://www.facebook.com/databricksinc Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner
More from this channel
-
28:25
Riot Games: Improving the Gaming Experience With Apache Spark
-
10:06
Big Data Meets Learning Science
-
29:07
Dependency injection in Apache Spark Applications by Shu Das and Sandeep Prabhakar
-
10:55
#SparkSummit 2017 Structured Streaming Demo - Michael Armbrust
-
15:27
Combating Abusive Language in Chat with Apache Spark - Wes Kerr
-
30:18
Yelp Ad Targeting at Scale with Apache Spark - Inaz Alaei-Novin and Joe Malicki
-
37:42
Scaling Data Science Capabilities with Apache Spark at Stitch Fix - Derek Bennett
-
30:08
Rental Cars and Industrialized Learning to Rank - Sean Downes