Главная
Study mode:
on
1
Introduction
2
Sponsor: AssemblyAI
3
Start of Interview
4
How the NIR company was founded?
5
What is Sparsity about?
6
Link between the human brain and sparsity
7
Where should the extra resource that the human brain doesn't have go?
8
Analogy for Sparse Architecture
9
Possible future for Sparse Architecture as standard architure for Neural Networks
10
Pruning & Sparsification
11
What keeps us from building sparse models?
12
Why are GPUs so unsuited for sparse models?
13
CPU and GPU in connection with memory
14
What Neural Magic does?
15
How do you deal with overlaps in tensor columns?
16
The best type of sparsity to execute tons of CPU
17
What kind of architecture would make the best use out of a combined system of CPUs and GPUs?
18
Graph Neural Networks in connection to sparsity
19
Intrinsic connection between the Sparsification of Neural Networks, Non Layer-Wise Computation, Blockchain Technology, Smart Contracts and Distributed Computing
20
Neural Magic's target audience
21
Is there a type of model where it works particularly well and the type where it doesn't?
Description:
Explore the cutting-edge advancements in sparsity and how they can make CPUs perform as fast as GPUs in this 50-minute interview with Nir Shavit. Dive into the world of sparse models and their efficient handling using plain CPUs, without the need for specialized hardware. Learn about Neural Magic's innovative algorithms for pruning and forward-propagation of neural networks, and understand the potential applications and significance of sparsity in the Deep Learning community. Discover the links between sparsity and the human brain, the challenges of building sparse models, and the advantages of CPUs over GPUs for sparse computations. Gain insights into the future of sparse architecture, its implications for various neural network types, and the potential synergies with blockchain technology and distributed computing.

How to Make Your CPU as Fast as a GPU - Advances in Sparsity with Nir Shavit

Yannic Kilcher
Add to list
#Computer Science #Artificial Intelligence #Neural Networks #Deep Learning #Distributed Computing #Machine Learning #Model Optimization #Blockchain Development #Smart Contracts
0:00 / 0:00
1 of 21

Introduction