Главная
Study mode:
on
1
Intro
2
Outline
3
Stream Processing is Hard
4
Assembling Page View
5
Streams
6
Jobs
7
Data flow
8
Why YARN?
9
Remote Stores
10
Problems with remote store
11
Stateful Tasks
12
Samza Store API
13
Usage patterns for stateful processing
14
Rocks DB Write Performance
15
Read Performance
16
Timeline Storage cluster
17
FollowFeed write architecture Timeline storage
18
Feed query path for Person:1
19
Timeline storage DB structure
20
Backups
21
RocksDB usage
22
RocksDB Performance
23
RocksDB experience
Description:
Explore how RocksDB is utilized in LinkedIn's FollowFeed and Apache Samza in this 29-minute conference talk from the RocksDB Meetup in December 2014. Gain insights into the backend system powering LinkedIn's feed applications and the distributed stream processing framework leveraging Apache Kafka and YARN. Discover the challenges of stream processing, the assembly of page view streams, and the importance of YARN. Learn about remote stores, stateful tasks, and the Samza Store API. Examine usage patterns for stateful processing, RocksDB's write and read performance, and the Timeline Storage cluster. Delve into FollowFeed's write architecture, feed query paths, and database structure. Understand backup strategies, RocksDB usage specifics, and overall performance metrics. Benefit from LinkedIn's experience with RocksDB implementation in their systems.

RocksDB Usage at LinkedIn - FollowFeed and Apache Samza

Meta
Add to list
0:00 / 0:00