Rethinking Microservices with Stateful Streams
Explore the concept of stateful streams in microservices architecture through this 51-minute Devoxx conference talk. Delve into the dichotomy between data accessibility and service encapsulation, and learn how to balance these competing forces in large-scale service-based systems. Discover how stateful stream processing and event-driven services, built on distributed logs like Apache Kafka, can improve scaling properties in terms of complexity, team size, data volume, and velocity. Gain insights from Ben Stopford, an engineer on the Apache Kafka Core Team at Confluent Inc, as he shares his extensive experience with distributed data infrastructure. Cover topics including encapsulation, decoupling, stream processing, event-driven services, database frameworks, and key principles for implementing these concepts effectively.