Domain-Driven Distributed Architecture... applied to Data
9
backed by domain-agnostic self-service data infrastructure
10
It's a mindset shift
11
Bring Your Own Bucket (BYOB)
12
Central Processing Platform
13
Simplify Data Sharing
14
Central Services with Global Interoperability
15
How to Ensure Data Quality?
16
Data Quality - A Contract between Consumer and Producer
Description:
Explore how Europe's leading online fashion platform transitioned from a centralized Data Lake to a distributed Data Mesh architecture in this 30-minute talk. Learn about the challenges of the Data Lake paradigm, including unclear responsibilities, lack of data ownership, and poor data availability. Discover how Zalando addressed these issues by implementing a decentralized, domain-focused approach that empowers data owners and promotes the concept of Data Products. Gain insights into the journey of building a Data Mesh architecture backed by Spark and Delta Lake, and understand ongoing efforts to simplify data product creation. Examine topics such as domain-driven distributed architecture, self-service data infrastructure, and the "Bring Your Own Bucket" concept. Delve into strategies for ensuring data quality through consumer-producer contracts and learn about central services with global interoperability in this informative presentation from Databricks.
Data Mesh in Practice - From Data Lake to Distributed Architecture at Zalando