Spark: A Coding Joyride - QCon SF 2015

3,135 views · Published 1 December 2015 · 53:24 · Indexed 8 November 2026

Channel: InfoQ · 2015 · Science & Technology

Watch on YouTube

In this talk from QCon SF, Doug Bateman will demonstrate Spark's ability to rapidly process Big Data through a live example project. He'll cover:
+ extracting information with RDDs
+ querying data using DataFrames
+ visualizing and plotting data
+ creating a machine-learning pipeline with Spark-ML and MLLib. 

Doug will also discuss the internals which make Spark 10-100 times faster than Hadoop MapReduce and Hive.

*https://newcircle.com
*https://databricks.com

More from this channel

• 1:13:58 Learn about Chrome OS and Chrome Web Store from Google

  InfoQ

  1,398 views · 22 March 2011

• 43:55 Android Builders Summit - Android: Beyond the Phone by Marko Gargenta

  InfoQ

  2,279 views · 20 April 2011

• 14:53 PhoneGap Ecosystem (part 2 of 2) - cross-platform app development in the cloud with PhoneGap Build

  InfoQ

  3,502 views · 20 June 2011

• 1:14:37 HTML5 Multimedia with Bruce Lawson

  InfoQ

  2,921 views · 6 July 2011

• 31:25 Scalability and Performance - Scaling an App Agile Style

  InfoQ

  3,033 views · 1 August 2011

• 22:35 Building Smart Async Functions For Mobile

  InfoQ

  685 views · 25 August 2011

• 41:30 Presentation: Google+ and the +1 Button from Timothy Jordan of Google

  InfoQ

  535 views · 15 September 2011

• 24:20 Getting the Native Feel: JavaScript for Mobile & Tablet Web Apps

  InfoQ

  3,462 views · 20 September 2011