Explore the critical aspects of security protection and quality control in crowdsourcing through this informative 33-minute conference talk presented by Weiping Pei from the Colorado School of Mines. Delve into the consequences of crowdsourcing, examine key research questions, and analyze the findings of an online survey. Gain insights into the threat model, results, and limitations of the study. Learn about annotation techniques, research goals, and unsurprised worker classification. Examine experimental results and draw valuable conclusions about the intersection of security and crowdsourcing in this comprehensive presentation from the CAE in Cybersecurity Community.