Beyond Malloc Efficiency to Fleet Efficiency - A Hugepage-Aware Memory Allocator
Explore a 14-minute conference talk from OSDI '21 that delves into TEMERAIRE, a hugepage-aware enhancement of TCMALLOC designed to optimize memory allocation at warehouse scale. Learn how this innovative approach goes beyond traditional malloc efficiency to improve fleet-wide productivity by maximizing hugepage coverage and minimizing fragmentation overheads. Discover the design and implementation strategies behind TEMERAIRE, including its impact on reducing CPU overheads in application code. Examine the results of application studies across 8 different applications, showcasing improvements in requests-per-second and RAM usage. Gain insights from a large-scale experiment and longitudinal rollout in Google's warehouse scale computers, revealing significant reductions in TLB miss stalls and memory fragmentation. Conclude with a discussion on enhancing allocator development processes and potential optimization strategies for future memory allocators.