Autoplay Next video from Max length

Accelerated Spark on Azure - Seamless and Scalable Hardware Offloads (Yuval Degani)

436 views · Published 27 September 2018 · 28:37 · Indexed 29 October 2026

Channel: Databricks · 2018 · Science & Technology

Yuval Degani is a Senior Manager of Engineering in Mellanox Technologies, leading a team of Software Engineers based in the San Francisco Bay Area.

In this talk, we will demonstrate how hardware accelerations in Azure can be utilized to speed-up Spark jobs seamlessly, with the aid of RDMA (Remote Direct Memory Access) support in the VM. We will demonstrate use cases of benchmarks and real-world applications, that achieve impressive performance improvements with minimal configuration.

To learn more: https://databricks.com/product/getting-started-guide

About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform

Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner

Accelerated Spark on Azure - Seamless and Scalable Hardware Offloads (Yuval Degani)

More from this channel