Look Who it Was Random video

State of Spark, and Where It is Going - Reynold Xin keynote

1,309 views · Published 3 December 2015 · 10:54 · Indexed 4 November 2026

Channel: O'Reilly · 2015 · Science & Technology

Watch on YouTube

From Strata + Hadoop World 2015 in Singapore: In this talk, Reynold will look back and review Spark’s growth in adoption, use cases, and development. He will then look forward and discuss both technical initiatives and the evolution of the Spark community for 2016.

2015 is the year of data science and platformization for Apache Spark. With new high-level APIs (e.g. DataFrames, machine learning pipelines, R) and extension points, Spark is accessible to a wider set of users and can plug in a myriad of data sources, algorithms, and external packages. 2015 also marks the beginning of Project Tungsten, a major revamp of Spark’s execution engine to improve its robustness and performance. In 2016, we will continue pushing the boundaries of these dimensions, making Spark even easier and more powerful.

About Reynold Xin (Databricks): Reynold Xin is a committer on Apache Spark. He is also a co-founder of Databricks. Before Databricks, he was pursuing a Ph.D. in the University of California-Berkeley AMPLab.

Watch more from Strata + Hadoop Singapore 2015: https://goo.gl/lBSB0b
Visit the O’Reilly data website: oreilly.com/data
Don't miss an upload! Subscribe! http://goo.gl/szEauh
Stay Connected to O'Reilly Media by Email - http://goo.gl/YZSWbO

Follow O'Reilly Media:
http://plus.google.com/+oreillymedia
https://www.facebook.com/OReilly
https://twitter.com/OReillyMedia

More from this channel