Challenges and Opportunities for Sparse Compilers in Large Language Models

Challenges and Opportunities for Sparse Compilers in Large Language Models

Explore the challenges and opportunities for sparse compilers in Large Language Models (LLMs) in this 16-minute conference talk presented at CTSTA'23. Gain insights into the latest developments in compiler technology for optimizing sparse computations in LLMs, understand the current limitations, and discover potential areas for improvement in this rapidly evolving field of artificial intelligence and machine learning.