Autoplay Next video from Max length

Scale Your Service on What Matters: Autoscaling on Latency - Thomas Rampelberg, Buoyant

3,432 views · Published 16 December 2018 · 32:17 · Indexed 31 October 2026

Channel: CNCF [Cloud Native Computing Foundation] · 2018 · Film & Animation

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Scaling HTTP based workloads is about more than cpu and memory. This talk will show why it is critical to scale based on latency, as well as how to do it for your own service by combining Linkerd, Prometheus, and Kubernetes. We demonstrate how to use Linkerd to instrument your service to collect aggregated service latency, store these metrics in Prometheus, and use them as custom metrics for consumption by Kubernetes’s Horizontal Pod Autoscaler. We demonstrate how latency-based autoscaling outperforms CPU- and memory-based autoscaling under a variety of conditions including live traffic from the attendees of this talk, and suggest ways to safely apply this technique to existing systems.

To Learn More: https://sched.co/GrR6

Scale Your Service on What Matters: Autoscaling on Latency - Thomas Rampelberg, Buoyant

More from this channel