Главная
Study mode:
on
1
Intro
2
Sometimes I wish I worked on ad ranking...
3
Abusive content on Facebook
4
Measuring abuse is hard!
5
Measuring abuse: The Dark Ages
6
Measuring Abuse: The Renaissance
7
Benefits of Measurement (in addition to a quieter office)
8
How do we get there?
9
Count what you blocked These things have to be bad, right?
10
Have users do the labeling Crowdsource the work via reporting/appeals flows.
11
Human labeling Get experts to decide for you.
12
Deployment at Facebook Used for internal direction and/or external reporting of
13
Deployment at Facebook Used for internal direction on
14
Comparison of approaches
15
Example: Rate Limiting
16
"Proof" of Goodhart's Law
17
Corollary: "Abuse Uncertainty Principle"
18
Living with the Uncertainty Principle For spam detection at Facebook, we split signals into two classes
19
Other coping mechanisms
20
Challenge: Build an Abuse Adapter!
21
Open questions
22
Thank you!
Description:
Explore the challenges and strategies of measuring and combating online abuse in this 27-minute conference talk from USENIX Enigma 2020. Delve into Facebook's approach to fighting spam, phishing, and other forms of internet abuse as David Freeman presents the "Abuse Uncertainty Principle" and discusses various measurement techniques. Learn about user reports, human labeling, and automated labeling methods, and understand their appropriate applications. Discover how effective abuse measurement can drive prioritization and impact analysis in integrity teams. Gain insights into determining background levels of spam and fake accounts, assessing detection system effectiveness, and identifying critical abuse problems. Examine the implications of the Abuse Uncertainty Principle on metric usage and explore strategies for developing reliable metrics to inform key decisions. Apply these tools to evaluate abuse levels in your product, assess prevention effectiveness, and determine areas for future investment. Read more

The Abuse Uncertainty Principle, and Other Lessons Learned from Measuring Abuse on the Internet - David Freeman - USENIX Enigma Conference - 2020

USENIX Enigma Conference
Add to list
0:00 / 0:00