Главная
Study mode:
on
1
intro
2
preamble
3
why to automate testing?
4
how to automate testing?
5
testing generative models is hard!
6
string matching
7
semantic similarity
8
llm-led evals
9
closeness between target, actual
10
using a grading rubric with marvin ai
11
a couple of other ideas
12
thank you!
Description:
Explore automated evaluation techniques for RAG chatbots and generative tools in this 14-minute conference talk from Conf42 LLMs 2024. Discover the importance of automating testing for generative models and learn about various approaches, including string matching, semantic similarity, and LLM-led evaluations. Gain insights into using grading rubrics with Marvin AI and explore additional ideas for effective automated testing. Understand the challenges of evaluating generative models and acquire practical strategies to improve your testing processes.

Automated Evaluation for RAG Chatbot or Other Generative Tool - Conf42 LLMs 2024

Conf42
Add to list
0:00 / 0:00