Statistical Learning Theory is about high confidence
4
Error distribution picture
5
Mathematical formalization
6
What to achieve from the sample?
7
Risk (aka error) measures
8
Before PAC Bayes
9
The PAC-Bayes framework
10
PAC Bayes aka Generalised Bayes
11
PAC Bayes bounds vs. Bayesian learning
12
A General PAC Bayesian Theorem
13
Proof of the general theorem
14
Linear classifiers
15
Form of the SVM bound
16
Slack variable conversion
17
Observations
18
Deep Network Training Experiments
19
Training and Generalisation Results
20
A flexible framework
21
Conclusions
Description:
Explore statistical learning theory for modern machine learning in this comprehensive seminar by John Shawe-Taylor from University College London. Delve into the foundations of learning generalization, high-confidence error distribution, and mathematical formalization. Examine risk measures, PAC-Bayes framework, and its comparison to Bayesian learning. Investigate the General PAC Bayesian Theorem and its proof, followed by an analysis of linear classifiers and SVM bounds. Gain insights from deep network training experiments and their results. Conclude with a discussion on the flexible framework of statistical learning theory and its implications for contemporary machine learning approaches.
Statistical Learning Theory for Modern Machine Learning - John Shawe-Taylor