Joint Embedding Method and Latent Variable Energy Based Models
Explore joint embedding methods and latent variable energy-based models (LV-EBMs) in this comprehensive lecture by Yann LeCun. Delve into predictive models, multi-output systems, and factor graph notation before examining energy functions and inference processes. Investigate conditional and unconditional EBMs, comparing them to probabilistic models. Learn about joint embeddings, latent variables, and their role in inference. Discover how to convert energy to probabilities and explore examples like K-means and sparse coding. Understand the training process for EBMs, including maximum likelihood and alternative loss functions. Examine contrastive joint embeddings and denoising autoencoders. Gain valuable insights into advanced machine learning concepts and techniques throughout this in-depth presentation.