Главная
Study mode:
on
1
Intro
2
Amandas background
3
Agenda
4
Data Engineers Journey
5
Delta Architecture
6
Delta Lake Architecture
7
Data Lifecycle Analogy
8
The Delta Lake Lifestyle
9
What can we do with Delta
10
Whats in the notebook
11
Importing data
12
Creating a bronze table
13
Creating a silver table
14
Creating a silver Delta table
15
Description of the silver Delta table
16
Live Demo
17
Updates Deletes and merges
18
Merges
19
Schema Evolution
20
Describe History
21
Recap
22
Using Delta Lake
23
Delta Lake Community
Description:
Explore the process of building scalable data engineering pipelines using Delta Lake in this 38-minute conference talk by Amanda Moran from Databricks. Learn about the 'multi-hop' architecture, which uses Bronze, Silver, and Gold tables to progressively structure data from ingestion to machine learning. Discover how to implement this architecture using Delta Lake, enabling a single source of truth for raw data. Follow along with a live demo showcasing importing data, creating Bronze and Silver tables, performing updates, deletes, and merges, as well as managing schema evolution. Gain insights into the Delta Lake lifestyle and its community, empowering you to become a champion in your organization's data engineering efforts.

Simplify and Scale Data Engineering Pipelines with Delta Lake

Databricks
Add to list
0:00 / 0:00