Automatic Hybrid MPI+OpenMP Code Generation
Explore the challenges and solutions for hybrid MPI+OpenMP programming in high-performance computing through this BoostCon 2011 talk. Delve into the Bulk Synchronous Parallelism paradigm and its suitability for hybrid systems. Learn about BSP++, a Boost-enabled C++ library for designing parallel applications based on the BSP model, and discover its API, integration with Boost libraries, and implementation details. Examine BSPGen, a parallel programming framework built on BSP++, Boost.Spirit, and Clang/LLVM, which generates hybrid parallel applications by evaluating runtime costs and optimizing OpenMP and MPI section balance. Gain insights into the complexities of MPI communications, OpenMP parallelization, and their interactions, while exploring automatic parallelization tools and libraries designed to address these challenges.