Главная
Study mode:
on
1
Introduction
2
Kafka Concepts
3
Need for Management
4
Cruise Control
5
Dynamic Load Balancing
6
Demotion for Cluster Maintenance
7
Anomaly Detection
8
Replica Move
9
Cruise Control Architecture
10
Metrics Reporter
11
Cluster Model
12
Metric Sampler
13
Sample Store
14
Capacity Resolver
15
Analyzer
16
Proposal Generation
17
Execution Limits
18
Anomaly Detector
19
Goal Violation
20
Broker Failure Detector
21
Metric Anomaly Detector
22
Metric Anomaly Finder
23
Mitigation
24
GMX Metrics
25
Summary
26
Future work
27
Demo
28
Kafka support
29
Preferred leader election
30
Preferred leader election results
31
Selfhealing actions
32
Second Data Center
33
Third Message
34
Kafka Consumer
35
Kafka Audit
36
Kafka Mirroring
37
What happened
38
Questions
39
Example
Description:
Explore the intricacies of managing large-scale Kafka clusters using Cruise Control at LinkedIn in this comprehensive 57-minute video presentation. Delve into the operational challenges faced by growing cluster sizes, increasing traffic volume, and aging infrastructure components. Learn how Cruise Control addresses these issues through its architecture and functionality. Follow along with a practical tutorial demonstrating real-world Kafka cluster management techniques. Gain insights into dynamic load balancing, anomaly detection, and self-healing actions. Understand the importance of metrics reporting, cluster modeling, and proposal generation in maintaining optimal performance and availability. Discover how LinkedIn leverages Cruise Control to mitigate cascading failures and reduce management overhead. Engage with the Q&A session to deepen your understanding of Kafka infrastructure management at scale.

How LinkedIn Navigates Streams Infrastructure Using Cruise Control - Adem Efe Gencer, PhD

Open Data Science
Add to list
0:00 / 0:00