Applied Data Science & Engineering for Local Weather Forecasts • Nikhil Podduturi • GOTO 2016
1,892 views · Published 12 April 2017 · 33:29 · Indexed 12 November 2026
Channel: GOTO Conferences · 2017 · Science & Technology
This presentation was recorded at GOTO Berlin 2016 http://gotober.com Nikhil Podduturi - Senior Data Engineer/Data Scientist at MeteoGroup ABSTRACT Progress in weather forecasting and in climate modelling over the past 50 years has been dramatic. Due to these dramatic improvements the data being generated increased exponentially. While the first computer ENIAC (Electronic Numerical Integrator and Computer) took 24 hours to make a 24 hour integration weather forecast, right now at MeteoGroup we generate weather forecasts for next 10 days on the fly from the browser. At the core of [...] TIMECODES 0:00 Introduction 0:57 Agenda 4:25 Types of data 6:21 Numerical weather prediction models 7:45 Outcome 8:55 MeteoGroup forecasting system 10:42 Next generation forecasting system 12:47 Iteration 1 13:40 Iteration 2 16:04 Baseline model engineering 19:09 Scaling with Apache Airflow 20:31 Apache Airflow DAG 21:31 Airflow and Mesos 23:44 Model improvement cycle 24:09 Forecast verification 24:35 Verification metrics 25:42 Results 27:37 Improvements 33:19 CONFERENCES Download slides and read the full abstract here: https://gotocon.com/berlin-2016/presentations/show_talk.jsp?oid=7999 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1
More from this channel
-
21:24
Jeff Sutherland & Ken Schwaber at ESE Conference Part II • GOTO 2011
-
51:03
Mature Legacy Seeking New Technology: Extracting Gold from Legacy Code • Dave Thomas • GOTO 2011
-
39:32
Reasons Node.js Submissions Get Rejected by SoundCloud • Phil Calçado • GOTO 2012
-
31:56
Engineering Culture • Alexander Grosse • GOTO 2012
-
2:30
Interview with Brian LeRoux • GOTO 2012
-
5:29
Interview with Simon Brown • GOTO 2012
-
19:00
Interview with Rich Hickey • GOTO 2012
-
23:48
Interview with Don Reinertsen • GOTO 2012