Learning Representations Using Causal Invariance - Leon Bottou
Explore a comprehensive lecture on learning representations using causal invariance delivered by Leon Bottou from Facebook AI Research at the Institute for Advanced Study's Workshop on Theory of Deep Learning. Delve into the challenges of machine learning, examining statistical problems as proxies and the impact of spurious correlations. Investigate the concept of multiple environments, the importance of negative mixtures, and the power of invariance in extrapolation. Analyze the relationship between invariance and causation, exploring applications in causal inference and adversarial domain adaptation. Examine robust supervised learning techniques, including linear least squares and nonlinear versions, and discover how these concepts apply to real-world scenarios such as colored MNIST datasets. Gain insights into scaling up invariant regularization and interpreting the underlying phenomena in this thought-provoking 33-minute presentation.