GeoSpatially enabling your Big Data Apache clusters with LocationTech by Robert Emanuele
322 views · Published 20 April 2017 · 46:09 · Indexed 20 October 2026
Channel: Devoxx · 2017 · Science & Technology
What is the average predicted temperature of San Francisco from 2050-2099 based on forecasting models? How many tweets containing the hashtag #devoxx were sent from California? In general: how do we ask questions concerning location to very large sets of geospatial data? To answer these types of questions, existing large data processing frameworks like Hadoop, Accumulo and Spark need to be "geospatially enabled". LocationTech is a working group inside of the Eclipse Foundation that is home to open source projects doing exactly that, including GeoTrellis, GeoWave, and GeoMesa (sense a pattern?). In this talk, I will give an introduction to what we mean when we talk about "geospatial data at scale", talk about some of the unique challenges in processing large sets of geospatial data, and talk about how LocationTech projects work with Apache projects to overcome those challenges, letting us get the most out of our large geospatial data. Rob Emanuele is the maintainer of the open source geospatial library GeoTrellis, which provides geospatial capabilities to Apache Spark. He was the program chair for FOSS4G North America in 2015 and 2016. He is a member of the LocationTech Project Management Committee.
More from this channel
-
32:13
Writing Groovy AST Transformations: Getting Practical in an hour! by Baruch Sadogursky
-
25:58
TweetWallFX - Behind the Scenes by Sven Reimers
-
29:44
Second generation "workflow managers" for big data by Alex Van Boxel
-
29:13
Secrets are secrets. Please maintain them as secrets by Alex Soto
-
2:13:40
JavaScript build pipelines with Gulp.js by Stefan Baumgartner
-
2:04:09
Powerful Metaprogramming Techniques With Groovy by Jeff Brown
-
2:38:32
Distributed Machine Learning 101 using Apache Spark from a Browser by Xavier Tordoir/Andy Petrella
-
2:36:21
Caching 101: Caching on the JVM (and beyond) by Alex Snaps/Louis Jacomet