Part II: Examining the Envoy Load Shedding Mechanisms
8
Rate/Bandwidth Limits vs. Concurrency Control
9
Shortcomings of Circuit Breakers
10
What if I told you there was a better way?
11
Adaptive Concurrency Control Filter
12
The gradient.
13
Concurrency Limit Behavior.
14
Configuring Adaptive Concurrency
15
Adaptive Concurrency Drawbacks
16
Admission Control Filter
Description:
Explore load shedding mechanisms in Envoy through this 32-minute conference talk from KubeCon + CloudNativeCon Europe 2022. Dive deep into circuit breaking, rate limiting, admission control, and adaptive concurrency, understanding their implementations, use cases, and potential pitfalls. Gain insights into queuing and scheduling concepts behind these mechanisms, and learn how they can fail to protect against noisy-neighbor problems. Discover experimental results based on FBThrift work and explore potential community improvements for Envoy. Examine topics such as Little's Law applied to servers, simulating overload, rate/bandwidth limits vs. concurrency control, shortcomings of circuit breakers, and the adaptive concurrency control filter. Understand the gradient, concurrency limit behavior, configuration of adaptive concurrency, and its drawbacks, as well as the admission control filter.