Azure Data Factory Ingestion Framework - Cloud

YouTube·PASS Data Community Summit

Explore a comprehensive framework for data lake ingestion using Azure Data Factory in this 52-minute conference talk from PASS Data Community Summit. Dive into data strategy and its impact on framework design, covering the development of a metadata database using Data Vault modeling, metadata collection techniques, and the creation of a fully automated Data Factory pipeline. Learn about data orchestration, ETL/ELT automation, data lake organization, and dynamic SQL implementation in ADF. Gain insights into ingestion conceptual architecture, schema loading, and other key features to enhance your data engineering skills and optimize your Azure-based data solutions.