ImageNet-9: A Fine-Grained Study Xiao Engstrom Ilyas M 2020
8
Adversarial Backgrounds
9
Background-Robust Models?
10
Are Better Models Better?
11
Biases Can Be Subtle
12
How Are Datasets Created?
13
Dataset Creation in Practice
14
Crowdsourced Validation: A Closer Look
15
Prerequisite: Detailed Annotations
16
Restricting Relevant Labels
17
From Validation to Classification
18
Multi-Object Images
19
How Does This Affect Accuracy?
20
Which Object Do Models Predict?
21
Human-Based Evaluation
22
Dataset Replication
23
Case Study: ImageNet-v2
24
Replication Pipeline
25
Statistical Bias
Description:
Explore the intricacies of machine learning models and their learning processes in this comprehensive lecture by Aleksander Mądry at the Institute for Advanced Study. Delve into the ML research pipeline, examining concerns such as classic and adaptive overfitting. Investigate the role of background bias in image classification, including studies on ImageNet-9 and adversarial backgrounds. Analyze the creation and validation of datasets, focusing on crowdsourced methods and the challenges of multi-object images. Evaluate the impact of dataset replication on model performance, using ImageNet-v2 as a case study. Gain insights into human-based evaluation techniques and the potential for statistical bias in machine learning research.