Current Systems Consider only Fully Equivalent Transformations
4
Motivating Example
5
PET Overview
6
Key Challenges
7
Mutant Generator
8
Challenges: Examine Transformations
9
A Strawman Approach
10
Multi-Linear Tensor Program (MLTP)
11
Mutant Corrector
12
Program Optimizer
13
More Evaluation in Paper
Description:
Explore a groundbreaking approach to optimizing tensor programs in this 15-minute conference talk from OSDI '21. Dive into PET (Partially Equivalent Transformations), a novel DNN framework that revolutionizes program optimization by applying transformations that maintain partial functional equivalence. Learn how PET automatically corrects results to restore full equivalence, unlocking previously missed optimization opportunities. Discover the rigorous theoretical foundations behind simplifying equivalence examination and correction, and understand the efficient search algorithm that combines fully and partially equivalent optimizations at multiple levels. Gain insights into PET's superior performance compared to existing systems, with improvements of up to 2.5 times. Examine key challenges, the mutant generator concept, multi-linear tensor programs, and the program optimizer in this cutting-edge presentation on enhancing deep neural network efficiency.
PET - Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections