Apache Arrow Optimization on Arm

Apache Arrow Optimization on Arm

Explore Apache Arrow optimization techniques for the Arm platform in this 29-minute conference talk. Gain insights from Yibo Cai, a Principal Software Engineer at Arm with over 20 years of industry experience, as he shares practical approaches to profiling and optimizing complex workloads. Learn about Top-down methodology, Arm SPE (Statistical Profiling Extension), and NEON, using upstream PRs as concrete examples. Discover how Arm SPE helped identify a performance bottleneck in Arrow CSV writer benchmark, resulting in a 50% performance improvement with minimal code changes. Acquire valuable knowledge on general software profiling and optimization, as well as Arm-specific techniques, applicable to big data, storage, and database projects.