Autoplay Next video from Max length

Best Practice of Compression Decompression Codes in Apache Spark (Sophie Sun)

2,856 views · Published 24 September 2018 · 28:43 · Indexed 18 October 2026

Channel: Databricks · 2018 · Science & Technology

Sophie Sun, a big data software engineer at Intel, and Xie Qi, a senior data architect at Intel, share best practices of compression/decompression codes.

Nowadays, people are creating, sharing and storing data at a faster pace than ever before, effective data compression / decompression could significantly reduce the cost of data usage. Apache Spark is a general distributed computing engine for big data analytics, and it has large amount of data storing and shuffling across cluster in runtime, the data compression/decompression codecs can impact the end to end application performance in many ways.

Learn more here: https://databricks.com/product/getting-started-guide
About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform

Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner

Best Practice of Compression Decompression Codes in Apache Spark (Sophie Sun)

More from this channel