Главная
Study mode:
on
1
Introduction
2
Machine learning success story
3
Limitations of machine learning
4
Humancentered
5
Traditional approach
6
Human performance
7
Communication
8
Evaluation framework
9
Quiz Bowl
10
Quiz Bowl online
11
Sentence order
12
Human component
13
Alternative answers
14
Explanation by examples
15
Explanation by features
16
Interface
17
Data
18
Regression analysis
19
Bias analysis
20
Fine grain analysis
21
Buzzing position
22
Failed interpretation
23
Conclusion
24
More detailed analysis
Description:
Explore a 20-minute conference talk from the 24th International Conference on Intelligent User Interfaces that delves into evaluating machine learning interpretations in cooperative play. Discover how researchers propose a novel approach to assess the interpretability and utility of AI models, particularly in natural language processing. Learn about their experimental design using a question answering task called Quizbowl, where both trivia experts and novices team up with AI. Gain insights into three different interpretation methods used by the computer to communicate predictions, and understand the framework for measuring interpretation effectiveness based on improved human performance. Examine the detailed analysis of human-AI cooperation, including regression analysis, bias analysis, and fine-grained analysis of buzzing positions. Uncover valuable design guidance for creating effective human-in-the-loop settings in natural language processing applications.

What Can AI Do for Me - Evaluating Machine Learning Interpretations in Cooperative Play

Association for Computing Machinery (ACM)
Add to list
0:00 / 0:00