Harness the power of Spark SQL with the Data Source API by Stefano Baghino
475 views · Published 12 March 2018 · 19:16 · Indexed 22 September 2026
Channel: Devoxx · 2018 · Science & Technology
A deep dive into the Spark Data Source API, which allows arbitrary data sources to be exposed for consumption through Spark SQL itself. You will be able to go beyond natively supported formats like JSON or CSV and query your favorite non-relational database or even your own web services through the convenient and familiar interface of SQL, using Spark itself as a distributed query engine. A software engineer for the past eight years but a lifelong developer and learner, Stefano was lucky enough to test his skills on several platforms (Web, mobile and native) to address the need of several industries (power generation, energy automation, finance, advertising, transportation). He has contributed to the Apache Flink project and now works as a Data Engineer at eBay, enabling a team of Data Scientists to explore large data sets and extract valuable insights.
More from this channel
-
2:38:32
Distributed Machine Learning 101 using Apache Spark from a Browser by Xavier Tordoir/Andy Petrella
-
5:03
Devoxx Belgium 2015 Interview Michael Hoffer
-
15:55
Fast Rest API building with Unfiltered by Joost den Boer
-
1:01:27
Lean Startup for Developers conference by Sebastien Arbogast
-
13:36
Interview Brasil Yara and Vini Senger Devoxx Belgium 2015
-
30:24
Running Docker in production on AWS by Oliver Geisser
-
33:59
Android Architecture Blueprints by David González
-
17:45
NoOps in the cloud by Constantijn Visinescu