Главная
Study mode:
on
1
Intro
2
Content distribution: a recurring
3
A lot of data to distribute
4
Exacting requirements
5
Prior approaches
6
Hierarchical caching
7
Owl: Centralization vs. decentrali
8
Owl: Ephemeral distribution tree
9
Scaling the control plane
10
Tracker sharding example
11
Tracker sharding with delegation
12
The Need for Flexibility
13
Emulation: Recording
14
Emulation: Replay
15
2021 Scaling: traffic vs. servers
16
BitTorrent vs. Owl in production
17
Conclusions
Description:
Explore a conference talk on Owl, a high-fanout distribution system for large data objects in Meta's private cloud. Learn how Owl combines a decentralized data plane using ephemeral peer-to-peer distribution trees with a centralized control plane for managing metadata and optimizing distribution. Discover how this innovative approach improves download speeds by 2-3 times compared to BitTorrent and previous static distribution trees. Understand the system's ability to handle over 800 petabytes of data daily, serving millions of client processes across 106 use cases with 55 different distribution policies. Gain insights into Owl's flexible policy interface, tracker sharding techniques, and the benefits of centralizing the control plane for scalability and customization.

Owl - Scale and Flexibility in Distribution of Hot Content

USENIX
Add to list