Ground Truth - The Uses and Abuses of Human Annotation in Text Analysis - Professor Kenneth Benoit
Explore the concept of "ground truth" in text analysis and its implications for social and cultural research in this 40-minute talk by Professor Kenneth Benoit at the Alan Turing Institute. Delve into the challenges of human annotation, examining sources of ground truth and their applications in various text analysis scenarios. Investigate methods for validating latent positions and learn about recoding experiments and intercoder agreement. Discover recent developments in text annotation using crowdsourcing, with examples from immigration and economic policy studies. Compare expert coding to crowd-sourced annotations, and understand the importance of quality control in these processes. Gain insights into the uses and potential abuses of human annotation in text analysis, bridging the gap between NLP/ML methodologies and humanities and social sciences research.