WHYTRANSFER LEARNING • Deep leaming successes have required a lot of labeled training data
3
FEW-SHOT LEARNING
4
MODERN TRANSFER LEARNING: FINE-TUNING
5
LEARNING PROBLEM STATEMENT
6
PROTOTYPICAL NETWORKS
7
MODEL-AGNOSTIC META-LEARNING • Training a 'fine-tuning procedure
8
EVALUATION: META-DATASET
9
UNIVERSAL REPRESENTATIONS
10
UNIVERSAL REPRESENTATION TRANSFORMER
11
RESULTS
12
REMAINING CHALLENGES
Description:
Explore transfer learning in deep learning with Hugo Larochelle's 44-minute conference talk from KDD2020. Delve into the importance of transfer learning, few-shot learning, and modern fine-tuning techniques. Examine prototypical networks, model-agnostic meta-learning, and the concept of training a fine-tuning procedure. Evaluate the meta-dataset approach and investigate universal representations and their transformers. Gain insights into the latest results in the field and discuss remaining challenges in transfer learning for deep neural networks.