Autoplay Next video from Max length

When Apache Spark Meets TiDB (Xiaoyu Ma)

543 views · Published 27 September 2018 · 23:33 · Indexed 6 November 2026

Channel: Databricks · 2018 · Science & Technology

Xiaoyu is a developer / tech lead in PingCAP mainly focus on OLAP related products. Previously he led the Big Data infrastructure team in Netease and SQL platform team in Quantcast.

Although Spark SQL has been proven effective parallel query processing engine, some tricks common in traditional databases are not available due to characteristics of storage underneath. TiSpark sits directly on top of a distributed database (TiDB)’s storage engine, expand Spark SQL’s planning with its own extensions and utilizes unique features of database storage engine to achieve functions not possible for Spark SQL on HDFS. With TiSpark, users are able to perform queries directly on changing / fresh data in real time.

To learn more: https://databricks.com/product/getting-started-guide

About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform

Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner

When Apache Spark Meets TiDB (Xiaoyu Ma)

More from this channel