How to Fail at Benchmarking
Explore the intricacies of effective benchmarking in this 54-minute Devoxx conference talk. Delve into crucial metrics for measurement, analyze the significance of average latency, and uncover the Coordinated Omission issue. Learn to identify common pitfalls in benchmarking, understand the importance of various factors like caches, clock resolution, and background noise, and gain insights into statistical concepts such as normal distribution and HDR histograms. Discover practical techniques for measuring response time, setting appropriate expectations, and interpreting results accurately. Equip yourself with the knowledge to conduct meaningful benchmarks, avoid misleading conclusions, and make informed decisions based on reliable performance data.