Главная
Study mode:
on
1
Intro
2
Abstract
3
Success of Artificial Intelligence
4
Neural networks
5
Deep learning
6
Importance unsupervised learning
7
ICA as principled unsupervised learning
8
Fundamental difference between ICA and PCA
9
Identifiability means ICA does blind source separation
10
Example of ICA: Brain source separation
11
Example of ICA: Image features
12
Nonlinear ICA is an unsolved problem
13
Darmois construction
14
Temporal structure helps in nonlinear ICA
15
Algorithmic trick: "Self-supervised" learning
16
Theorem: TCL estimates nonlinear nonstationary ICA Assume data follows nonlinear ICA model (t)-f s(tl) with
17
Permutation contrastive learning (Hyvärinen and Morioka 2017)
18
Illustration of demixing capability by PCL Non Gaussian AR model for sources
19
Extensions of nonlinear ICA on time series
20
General framework: Deep Latent Variable Models
21
Conditioning makes DLVM identifiable
22
Alternative approaches to DLVM case
23
Conclusion
Description:
Explore nonlinear independent component analysis in this seminar on theoretical machine learning presented by Aapo Hyvärinen from the University of Helsinki. Delve into the fundamental differences between ICA and PCA, examine the success of artificial intelligence and deep learning, and understand the importance of unsupervised learning. Discover how ICA performs blind source separation, with examples in brain source separation and image features. Investigate the unsolved problem of nonlinear ICA, including the Darmois construction and how temporal structure aids in nonlinear ICA. Learn about the algorithmic trick of "self-supervised" learning and the theorem on TCL estimates for nonlinear nonstationary ICA. Examine permutation contrastive learning and its demixing capability, as well as extensions of nonlinear ICA on time series. Explore the general framework of Deep Latent Variable Models and how conditioning makes DLVM identifiable. Gain insights into alternative approaches to the DLVM case in this comprehensive seminar on advanced machine learning concepts. Read more

Nonlinear Independent Component Analysis - Aapo Hyvärinen

Institute for Advanced Study
Add to list
0:00 / 0:00