Incorporating LLMs in High-stake Use Cases - Best Practices and Considerations
Explore best practices for incorporating Large Language Models (LLMs) in high-stakes applications through this insightful conference talk by Yada Pruksachatkun. Learn how to build applications with non-determinism in mind, consider human-in-the-loop systems, and address challenges in deploying LLMs for critical use cases. Discover techniques for breaking tasks into smaller components, utilizing in-context examples, and evaluating models rigorously. Gain valuable insights on when to use LLMs, the benefits of fine-tuning custom models, and open questions surrounding black-box LLMs in high-risk scenarios. Drawing from her experience as an NLP scientist and engineer, Pruksachatkun provides practical guidance for leveraging LLMs responsibly in production environments.