How to Make Your CPU as Fast as a GPU - Advances in Sparsity with Nir Shavit
Explore the cutting-edge advancements in sparsity and how they can make CPUs perform as fast as GPUs in this 50-minute interview with Nir Shavit. Dive into the world of sparse models and their efficient handling using plain CPUs, without the need for specialized hardware. Learn about Neural Magic's innovative algorithms for pruning and forward-propagation of neural networks, and understand the potential applications and significance of sparsity in the Deep Learning community. Discover the links between sparsity and the human brain, the challenges of building sparse models, and the advantages of CPUs over GPUs for sparse computations. Gain insights into the future of sparse architecture, its implications for various neural network types, and the potential synergies with blockchain technology and distributed computing.