Look Who it Was Random video

Deep Dive: Big Data SIG - Erik Erlandson, Red Hat & Yinan Li, Google

1,369 views · Published 16 December 2018 · 40:57 · Indexed 4 November 2026

Channel: CNCF [Cloud Native Computing Foundation] · 2018 · Film & Animation

Watch on YouTube

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Deep Dive: Big Data SIG - Erik Erlandson, Red Hat & Yinan Li, Google 

This presentation will cover two projects from sig-big-data: Apache Spark on Kubernetes and Apache Airflow on Kubernetes. Kubernetes became a native scheduler backend for Spark in 2.3 and we have been working on expanding the feature set as well as hardening the integration since then. Apache Airflow on Kubernetes achieved a big milestone with the new Kubernetes Operator for natively launching arbitrary Pods and the Kubernetes Executor that is a Kubernetes native scheduler for Airflow. We will give an overview of the current state and present the roadmap of both projects, and give attendees opportunities to ask questions and provide feedback on roadmaps. 

To learn more:  https://sched.co/Greq

More from this channel