Scaling OpenTelemetry Collectors Using Kafka - Conf42 SRE 2024

YouTube·OpenTelemetry

Explore a conference talk on scaling OpenTelemetry collectors using Kafka, presented by Pranay Prateek at Conf42 SRE 2024. Dive into the world of observability platforms, focusing on SigNoz, an open-source solution. Learn about OpenTelemetry's importance and its collector architecture. Examine the challenges of scaling with OpenTelemetry collectors alone and discover how integrating Kafka can address these issues. Gain insights into Kafka setup, monitoring consumer lag, scaling strategies, and producer-consumer latency. Understand the benefits of a Kafka-based architecture and potential areas for improvement. Get involved in the growing community and expand your knowledge of modern observability solutions for site reliability engineering.