Instruction Tuning of Large Language Models - Lecture
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only! Grab it Explore the concept of instruction tuning for large language models in this 48-minute lecture by Yizhong Wang from the University of Washington. Delve into the evolution of NLP models, from task-specific approaches to generalist models like ChatGPT and GPT-4. Examine the impact of expert-written instructions and cross-task generalization on model performance. Investigate the factors contributing to LLM improvements, including data quality and quantity. Learn about innovative techniques for generating instruction datasets using GPT-3, and evaluate their effectiveness through performance metrics and expert assessments. Consider the implications of data size and quality on model capabilities, and reflect on potential licensing concerns related to using OpenAI-generated content.