Explore the evolution and challenges of neural models in speech and language processing through this insightful lecture by Michael Collins from Google Research and Columbia University. Delve into the statistical and neural revolutions in natural language processing, examining key concepts such as kernel methods, word embeddings, and parsing problems. Learn about innovative architectures like Transformers and Multi-Head Transformers, and their applications in solving complex language tasks. Gain a comprehensive understanding of three significant problems in the field and the corresponding architectures designed to address them.
Successes and Challenges in Neural Models for Speech and Language - Michael Collins