Revisiting Nearest Neighbors from a Sparse Signal approximation view
3
What is a neighborhood?
4
Neighborhood definitions: Kernels (Similarity)
5
Neighborhood definitions: Local linearity
6
Interlude: Sparse Signal Approximation
7
Neighborhood = Sparse signal approximation
8
Alternative: Basis pursuit
9
Neighborhoods: Non-negative basis pursuit
10
Non-Negative Kernel regression (NNK)
11
Geometry: Kernel Ratio Interval (KRI)
12
Example
13
Label propagation using graphs
14
Experiments: Label propagation
15
Experiments: Classification
16
Neighborhoods Summary
17
Conventional Approach
18
Solution: NNK-Means
19
kMeans vs Dictionary learning
20
Case study: Detecting unseen data using NNK-Means (representational outliers)
21
NNK-Means atom use in each scenario
22
NNK-Means for Outlier Detection
23
NNK-Means Summary
24
What is deep learning?
25
Graph based view of deep learning
26
NNK interpolation at penultimate layer
Description:
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Grab it
Explore a Google TechTalk presented by Sarath Shekkizhar that delves into revisiting nearest neighbors from a sparse signal approximation perspective. Gain insights into alternative neighborhood definitions, focusing on non-negative kernel regression (NNK) as an improved and efficient approach. Learn about the interpretation of neighborhoods as sparse signal approximation problems and how this view can enhance graph-based signal processing and machine learning. Discover a k-means-like algorithm leveraging NNK for data summarization and outlier detection. Examine a graph framework for empirically understanding deep neural networks, providing insights into model similarities, differences, invariances, and generalization performance. Explore topics such as kernel similarity, local linearity, basis pursuit, and the geometry of kernel ratio intervals. Witness practical applications through experiments in label propagation and classification, and understand the potential of NNK-Means for detecting representational outliers.
Read more
Revisiting Nearest Neighbors from a Sparse Signal Approximation View