Advanced Multi-GPU Programming with OpenACC - Lecture 2
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only! Grab it Explore advanced multi-GPU programming techniques using MPI and OpenACC in this second lecture of the Advanced OpenACC Course. Delve into Message Passing Interface (MPI) concepts, including MPI skeleton, compiling, and launching. Learn through practical examples like the Jacobi solver, and discover strategies for handling multi-GPU nodes. Gain insights into tools for MPI+OpenACC applications, including memory checking with CUDA-memcheck, debugging, and profiling. Examine GPU acceleration of legacy MPI apps and processes sharing GPUs without MPS. Study Hyper-Q/MPS case studies, focusing on UMT, and understand MPS benefits. Master communication and computation overlap techniques, domain decomposition strategies, and their implementation in multi-GPU environments. Conclude with an exploration of Multi-Process Service (MPS) and Unified Virtual Addressing for enhanced GPU utilization.