Главная
Study mode:
on
1
Introduction
2
Problems with Neural Networks
3
Key to Debugging
4
Problem
5
Possible Causes
6
Debugging Training Time
7
Model Size
8
Residual Connections Highway Networks
9
Optimization
10
Optimizers
11
Learning Rate
12
Initialization
13
Mini Batching
14
Sorting
15
Learning Rate Decay
16
Other Questions
17
Test Time Performance
18
Minibatch Bugs
19
Unit Testing
20
Beam Search
21
Output Generation
22
Quantitative Analysis
23
Compare Empty Toolkit
24
Battling Overfitting
25
Memory
Description:
Learn essential techniques for debugging neural networks in natural language processing applications. This comprehensive lecture covers identifying problems, addressing training time issues, and resolving test time challenges. Explore strategies for optimizing model size, implementing residual connections, fine-tuning optimizers and learning rates, and improving initialization. Discover methods for effective mini-batching, learning rate decay, and battling overfitting. Gain insights into debugging test time performance, including minibatch bugs, unit testing, beam search, and output generation. Master quantitative analysis techniques and compare empty toolkit approaches to enhance your neural network debugging skills for NLP tasks.

Neural Nets for NLP - Debugging Neural Nets

Graham Neubig
Add to list
0:00 / 0:00