Applied Data Science & Engineering for Local Weather Forecasts • Nikhil Podduturi • GOTO 2016

1,892 views · Published 12 April 2017 · 33:29 · Indexed 12 November 2026

Channel: GOTO Conferences · 2017 · Science & Technology

Watch on YouTube

This presentation was recorded at GOTO Berlin 2016
http://gotober.com

Nikhil Podduturi - Senior Data Engineer/Data Scientist at MeteoGroup

ABSTRACT
Progress in weather forecasting and in climate modelling over the past 50 years has been dramatic. Due to these dramatic improvements the data being generated increased exponentially. While the first computer ENIAC (Electronic Numerical Integrator and Computer) took 24 hours to make a 24 hour integration weather forecast, right now at MeteoGroup we generate weather forecasts for next 10 days on the fly from the browser. At the core of [...]

TIMECODES
0:00 Introduction
0:57 Agenda
4:25 Types of data
6:21 Numerical weather prediction models
7:45 Outcome
8:55 MeteoGroup forecasting system
10:42 Next generation forecasting system
12:47 Iteration 1
13:40 Iteration 2
16:04 Baseline model engineering
19:09 Scaling with Apache Airflow
20:31 Apache Airflow DAG
21:31 Airflow and Mesos
23:44 Model improvement cycle
24:09 Forecast verification
24:35 Verification metrics
25:42 Results
27:37 Improvements
33:19 CONFERENCES

Download slides and read the full abstract here:
https://gotocon.com/berlin-2016/presentations/show_talk.jsp?oid=7999

https://twitter.com/GOTOcon
https://www.linkedin.com/company/goto-
https://www.facebook.com/GOTOConferences

Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter

SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1

More from this channel