Generative Modeling by Estimating Gradients of the Data Distribution - Stefano Ermon
Explore a comprehensive seminar on generative modeling techniques focusing on estimating gradients of data distributions. Delve into implicit generative models, deep energy-based models, and score estimation methods presented by Stanford University's Stefano Ermon at the Institute for Advanced Study. Learn about the progress in generative models for text, representation of probability distributions, and scalable learning techniques using sliced score matching. Discover potential pitfalls in sample generation, including the manifold hypothesis and inaccurate score estimation in low data-density regions. Examine innovative solutions such as Gaussian perturbation and annealed Langevin dynamics. Gain insights into joint score estimation and practical experiments demonstrating the effectiveness of these approaches in various sampling scenarios.