Rental Cars and Industrialized Learning to Rank - Sean Downes
182 views · Published 8 June 2017 · 30:08 · Indexed 13 October 2026
Channel: Databricks · 2017 · Science & Technology
"Data can be viewed as the exhaust of online activity. With the rise of cloud-based data platforms, barriers to data storage and transfer have crumbled. The demand for creative applications and learning from those datasets has accelerated. Rapid acceleration can quickly accrue disorder, and disorderly data design can turn the deepest data lake into an impenetrable swamp. In this talk, I will discuss the evolution of the data science workflow at Expedia with a special emphasis on Learning to Rank problems. From the heroic early days of ad-hoc Spark exploration to our first production sort model on the cloud, we will explore the process of industrializing the workflow. Layered over our story, I will share some best practices and suggestions on how to keep your data productive, or even pull your organization out of the data swamp." About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business. Read more here: https://databricks.com/product/unified-data-analytics-platform Connect with us: Website: https://databricks.com Facebook: https://www.facebook.com/databricksinc Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner
More from this channel
-
28:25
Riot Games: Improving the Gaming Experience With Apache Spark
-
10:06
Big Data Meets Learning Science
-
29:07
Dependency injection in Apache Spark Applications by Shu Das and Sandeep Prabhakar
-
30:18
Yelp Ad Targeting at Scale with Apache Spark - Inaz Alaei-Novin and Joe Malicki
-
37:42
Scaling Data Science Capabilities with Apache Spark at Stitch Fix - Derek Bennett
-
30:35
Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash - Patrick Stuedi
-
30:50
Lazy Join Optimizations Without Upfront Statistics - Matteo Interlandi
-
30:25
Microservices and Teraflops: Effortlessly Scaling Data Science with PyWren