Monitoring - Turning Noise into Signal
Explore effective monitoring techniques in this ACCU 2019 conference talk by Chris Oldwood. Learn how to transform unstructured log files into valuable insights by implementing structured logging approaches and understanding the dual perspectives of operations and development. Discover methods to enhance system monitoring, including dependencies and consumers, to better pinpoint issues when alerts arise. Gain knowledge on modern tooling for querying and visualization, while acknowledging their limitations. Understand how to incorporate lessons learned from resolved issues into the backlog, enabling system adaptation and improved signal-to-noise ratio in monitoring data. Delve into topics such as the Dev+Ops divide, full pipeline development, self-healing systems, instrumentation, transient blips, long-term trends, aggregatable logging, minimal event structure, naming conventions, diagnostic context, causality, and local aggregations.