CMU Advanced NLP: Prompting + Sequence-to-Sequence Pre-Training

CMU Advanced NLP: Prompting + Sequence-to-Sequence Pre-Training

Explore advanced natural language processing techniques in this comprehensive lecture from CMU's CS 11-711 course. Delve into prompting methods, sequence-to-sequence pre-training, and prompt engineering. Learn about answer engineering, multi-prompt learning, and prompt-aware training methods. Discover the intricacies of feature, architecture, and objective engineering. Examine various prompting techniques, including prompt templates, mining, and paraphrasing. Gain insights into pretraining model choices and methods, as well as autoprompt and prefix prompt tuning. Enhance your understanding of cutting-edge NLP concepts and their practical applications in this in-depth, 77-minute presentation by Graham Neubig.