Data on the Inside, Data on the Outside
Explore the challenges and solutions of distributed data management in microservices architecture through this comprehensive conference talk. Delve into the concept of "Data on the Inside vs. Data on the Outside" as presented by Pat Helland in 2005, and learn how to effectively handle shared data across autonomous services. Discover strategies for managing reference data, including implementation techniques using ATOM feeds, discrete messaging, and event streams. Gain practical insights through examples in C#, Python, and Go, as well as demonstrations using RabbitMQ and Kafka. Address common issues such as chatty service calls, large message payloads, and maintaining data consistency across service boundaries. Understand how to balance service autonomy with the need for shared information, and learn best practices for scaling distributed data systems in a microservices environment.