Stateless Fluentd with Kafka

Stateless Fluentd with Kafka

Explore a conference talk on implementing stateless Fluentd with Kafka for improved log processing and routing. Discover how Usabilla addressed the limitations of traditional centralized log aggregation using Fluentd. Learn about their innovative approach utilizing Kafka as a centralized, highly available log buffer. Gain insights into the new components developed to adapt Fluentd for stateless operation and the methods used to reliably feed logs into Kafka from globally distributed hosts. Understand the benefits of this failure-tolerant design and get an overview of remaining challenges in log management at scale.