Measuring Inter-Annotator Agreement - Can You Trust Your Gold Standard?

Measuring Inter-Annotator Agreement - Can You Trust Your Gold Standard?

Explore methods for objectively evaluating manual annotations in machine learning experiments during this 37-minute conference talk from #HLTCon 2018. Learn how to assess the quality and reliability of annotated data used for developing training datasets or creating evaluation datasets for supervised and unsupervised machine learning applications. Gain insights into measuring inter-annotator agreement and building confidence in your gold standard annotations to ensure the success of your machine learning projects.