Главная
Study mode:
on
1
Intro
2
(Over?)fitting the dataset
3
Label memorization
4
What about theory?
5
Interpolation
6
Hard atypical examples
7
Subpopulations
8
Long-tailed data
9
The tail rears its head
10
Model
11
Benefits of fitting
12
Fitting and memorization
13
Beyond discrete domains
14
Coupling
15
Experimental validation (with Chiyuan Zhang)
16
Conclusions
Description:
Explore the relationship between learning and memorization in machine learning through a thought-provoking 25-minute ACM conference talk. Delve into concepts such as overfitting, label memorization, and the role of theory in learning. Examine the importance of interpolation, hard atypical examples, and subpopulations in dataset analysis. Investigate the challenges posed by long-tailed data distributions and their impact on model performance. Discuss the benefits and potential drawbacks of fitting data, including its connection to memorization. Extend the analysis beyond discrete domains and explore the concept of coupling. Review experimental validation conducted with Chiyuan Zhang, and draw insightful conclusions about the nature of learning and memorization in artificial intelligence.

Does Learning Require Memorization? A Short Tale About a Long Tail

Association for Computing Machinery (ACM)
Add to list
0:00 / 0:00