Главная
Study mode:
on
1
– 2021 edition disclaimer
2
– Conditional and unconditional LV EBM
3
– Variables' name: x, y, z, h, ỹ
4
– LV EBM training recap, warm case
5
– LV EBM training recap, zero-temperature limit
6
– Today's plan: the missing step
7
– Target propagation
8
– From target prop to autoencoder
9
– Reconstruction costs
10
– Loss functional
11
– Under and over complete hidden layer
12
 – Denoising autoencoder
13
– Contractive autoencoder
14
– Autoencoders recap
15
– From autoencoder to variational autoencoder
16
– Comparison between variational autoencoder and denoising autoencoder
17
– How a variational autoencoder actually works
18
– The bubble-of-bubble variational autoencoder interpretation
19
– And that was it :
Description:
Explore the evolution of machine learning models in this comprehensive lecture, starting from Latent Variable Energy-Based Models (LV-EBM) and progressing through target propagation to various types of autoencoders. Delve into conditional and unconditional LV-EBMs, understand the training process for warm cases and zero-temperature limits, and discover the crucial missing step in model development. Learn about target propagation and its transition to autoencoders, examining reconstruction costs, loss functionals, and the impact of under and over-complete hidden layers. Investigate specialized autoencoder variants, including denoising and contractive autoencoders, before culminating in an in-depth exploration of variational autoencoders. Compare different autoencoder types, gain insights into the inner workings of variational autoencoders, and grasp the innovative bubble-of-bubble interpretation for a thorough understanding of these powerful machine learning techniques.

From LV-EBM to Target Prop to Autoencoder

Alfredo Canziani
Add to list
0:00 / 0:00