Главная
Study mode:
on
1
Intro
2
Microservices
3
Board
4
How is it stored?
5
How is it queried?
6
How do we get ?
7
Enriched entity
8
Entity from cursor and id
9
Multiple DBS
10
No interference
11
Using it
12
Sample message
13
Sample query
14
Model service
15
Output
16
Scoring time
17
Training time
18
RDDs: our use case
19
Sharding queries
20
Data access
21
Learning curve
22
Testimonials
Description:
Explore an innovative approach to data science architecture in this conference talk that leverages Datomic, Spark, and Kafka for scalable real-time analysis of production data without traditional ETL techniques. Discover how immutability, consistent timelines, and multi-database querying enable machine learning models with full traceability in a microservices architecture. Learn about modern stored procedures, pass-by-reference queries, horizontal read scalability, and an immutable messaging substrate. Gain insights into an alternative to lambda and kappa architectures, addressing sensitive data encryption and information security concerns. Understand how this solution eliminates the need for ETL and database synchronization pipelines while maintaining scalability and isolation for both transactional and analytical use cases.

Immutable Data Science with Datomic, Spark and Kafka

Strange Loop Conference
Add to list