Autoplay Next video from Max length

Apache Spark for Library Developers (William Benton & Erik Erlandson)

129 views · Published 27 September 2018 · 28:06 · Indexed 1 October 2026

Channel: Databricks · 2018 · Science & Technology

William Benton, manager at Red Hat, and Erik Erlandson, a Software Engineer at Red Hat, discuss how as a developer, data engineer, or data scientist, you’ve seen how Apache Spark is expressive enough to let you solve problems elegantly and efficient enough to let you scale out to handle more data. However, if you’re solving the same problems again and again, you probably want to capture and distribute your solutions so that you can focus on new problems and so other people can reuse and remix them: you want to develop a library that extends Spark.

Learn more here: https://databricks.com/session/apache-spark-for-library-developers

Article you might like: https://databricks.com/session/using-apache-spark-to-tune-spark
About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform

Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner

Apache Spark for Library Developers (William Benton & Erik Erlandson)

More from this channel