Canarying Well - Lessons Learned from Canarying Large Populations
Explore the intricacies of canarying in production environments through this insightful conference talk from SREcon18 Europe. Delve into common pitfalls, best practices, and a comprehensive end-to-end strategy for implementing effective canary processes. Learn from Google's Štěpán Davidovič as he shares valuable lessons on controlled rollouts to mitigate risks in large-scale systems. Gain a deeper understanding of canarying priorities, geographical distribution challenges, high variance scenarios, and bimodal distributions. Examine real-world examples involving service caches, memory leaks, and compound probabilities. Discover the importance of careful metric selection and analysis in ensuring successful canary deployments. Walk away with practical knowledge on implementing a robust three-step canary process to enhance the safety and reliability of your production changes.