Building Trust with Large Language Models - Evaluation Techniques
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only! Grab it Explore the intricacies of evaluating Large Language Models (LLMs) in this 34-minute conference talk from DevConf.US 2024. Delve into the fundamental aspects of LLM assessment, starting with traditional metrics like ROUGE and BLEU scores, and progressing to advanced techniques such as model-based evaluation using LangChain criteria metrics. Examine human-based evaluation methods and various evaluation benchmarks. Through a text generation demo application, compare different evaluation techniques, highlighting their advantages and disadvantages. Address common challenges in assessing LLM quality and learn strategies to overcome them. Gain a comprehensive understanding of LLM evaluation techniques to build trust and effectively implement these models in real-world applications. Presented by speakers Surya Pathak and Hema Veeradhi, this talk equips you with practical insights for navigating the complexities of LLM implementation in the open-source world.