Processing Global Geospatial Datasets from OpenStreetMap and NASA Satellites
871 views · Published 24 September 2018 · 28:24 · Indexed 4 November 2026
Channel: Databricks · 2018 · Science & Technology
Eugene Cheipesh is a software engineer at Azavea working on the GeoTrellis project to bring big data geo-spatial processing capability to the open source ecosystem. In this talk we will demonstrate GeoTrellis, an open source, geographic data processing library designed to work with large geospatial raster and vector datasets on Apache Spark. In previous Spark Summit talk we introduced GeoTrellis design and its integration with Spark. Today we will give brief feature update and showcase newly added geospatial ETL workflows, analytics algorithms, and integration with Databricks notebook. In our use case we will show how to use publicly available elevation data from the NASA Shuttle Radar Topography Mission (SRTM) and the road network datasets from OpenStreetMap (OSM) to generate a cost distance surface which represents the difficulty of traveling across the terrain given said road network. To learn more: https://databricks.com/product/getting-started-guide About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business. Read more here: https://databricks.com/product/unified-data-analytics-platform Connect with us: Website: https://databricks.com Facebook: https://www.facebook.com/databricksinc Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner
More from this channel
-
28:25
Riot Games: Improving the Gaming Experience With Apache Spark
-
10:06
Big Data Meets Learning Science
-
29:07
Dependency injection in Apache Spark Applications by Shu Das and Sandeep Prabhakar
-
10:55
#SparkSummit 2017 Structured Streaming Demo - Michael Armbrust
-
15:27
Combating Abusive Language in Chat with Apache Spark - Wes Kerr
-
30:18
Yelp Ad Targeting at Scale with Apache Spark - Inaz Alaei-Novin and Joe Malicki
-
37:42
Scaling Data Science Capabilities with Apache Spark at Stitch Fix - Derek Bennett
-
30:08
Rental Cars and Industrialized Learning to Rank - Sean Downes