Towards Statistical Optimality for Covariance Estimation
9
Towards Statistical Optimality for Linear Regression
10
Outline
11
Median of Means Framework
12
Median of Means - One Dimensional Case
13
Tournament Estimator - High Dimensional Version
14
Testing a Candidate Matrix - Optimization Problem
15
Sos Relaxation - Analysis
16
Sos Relaxation - Concentration Step
17
Sos Relaxation - Expectation Step
18
Matrix Bernstein?
19
Getting Around Matrix Bernstein
20
Evidence of Hardness for Covariance Estimation
21
Low degree Tests for Detection
Description:
Explore advanced algorithms for heavy-tailed statistics in this 20-minute conference talk from the Association for Computing Machinery (ACM). Delve into high probability estimation techniques, Gaussian covariance estimation, and linear regression methods. Learn about covariance estimation and linear regression rates under weak assumptions, and examine key SOS (Sum of Squares) assumptions. Investigate the Median of Means framework, including one-dimensional cases and high-dimensional tournament estimators. Analyze SOS relaxation techniques, covering optimization problems, concentration steps, and expectation steps. Discuss Matrix Bernstein inequalities and their limitations, as well as evidence of hardness for covariance estimation. Conclude by exploring low-degree tests for detection in heavy-tailed statistical scenarios.
Algorithms for Heavy-Tailed Statistics - Regression, Covariance Estimation, and Beyond