Part 1 - Mathematical formalization of Machine Learning ML
24
Old Idea: Curve fitting Legendre, Gauss, c. 1800
25
Example: Learning to score reviews
26
Example: Learning to rate reviews contd
27
ML ~ finding suitable function "model" given examples of desired input/output behavior
28
Formal framework
29
Training via Gradient Descent "natural algorithm"
30
Subcase: deep learning* deep models = "multilayered"
31
Summary so far:
32
Unsupervised learning no human-supplied labels
33
A Language model baby "word2ver" [Mikolov et al'1 3]
34
Properties of semantic word vectors
35
Sequential decision-making framework
36
Game-playing via Deep Learning crude account of Alpha-Go Zero
37
Part 3 - Toward mathematical understanding of Deep Learning
38
Special case: deep learning deep = "multilayered"
39
Some key questions
40
Analysis of optimization
41
Black box analysis sketch
42
More about optimization in next talk, including recent works using trajectory analysis for gradient descent
43
Why no overfitting?
44
Part 4 - Taking stock, wrapping up
45
1. Imitation approach has not worked well in the past: airplanes, chess/go etc.
46
Sample Task: "Decoding" Brain fMRI [Vodrahalli et al, Neurolmage'17]
47
Brain regions useful for decoding
48
Can Machine Learning thrive in India?
49
Concluding thoughts on ML
50
Q&A
Description:
Explore the foundations of machine learning in this comprehensive lecture by Sanjeev Arora from Princeton University. Delve into the mathematical formulations of various learning types, including supervised, unsupervised, and interactive learning. Gain insights into the philosophical and scientific issues surrounding machine learning. Examine key concepts such as curve fitting, gradient descent, and deep learning models. Discover applications in natural language processing, game playing, and brain fMRI decoding. Investigate the challenges of optimization and overfitting in deep learning. Conclude with a discussion on the future of machine learning and its potential impact in India. Engage in a thought-provoking Q&A session to further enhance your understanding of this rapidly evolving field.
Mathematics of Machine Learning: An Introduction - Lecture 1