Enable Unified Data Governance with Azure Purview - Azure Friday
Discover how Azure Purview simplifies data governance with automated discovery, classification, and lineage tracking. Learn to create a comprehensive map of your data landscape across multiple environments.
Microsoft Purview Data Governance
Expand your knowledge of Microsoft Purview data governance. Learn about building data catalogs, data maps, and end-to-end lineage. Explore permission management, collections, and supported data sources.
Construction Practice of Xiaomi Flink Real-Time Computing Platform
Explore Xiaomi's real-time computing platform construction, focusing on resource flexibility, cost-effectiveness, and usability. Gain insights into architecture, metadata management, and operational governance.
FlinkSQL's Field Lineage and Data Permission Solution
Explore FlinkSQL's field lineage and data permission solutions for real-time data warehouses. Learn to implement Atlas and Ranger-like capabilities without source code intrusion.
Building Privacy Aware Infrastructure
Explore privacy-focused infrastructure design, understanding regulations, core principles, and practical measures for implementing privacy-aware systems in platform engineering.
Diving into Delta Lake: Understanding the Transaction Log
Explore Delta Lake's transaction log: its structure, functionality, and role in ACID transactions, metadata handling, time travel, and concurrent operations. Gain insights into this core component.
Re-Imagining Apache Spark Development - Tools for Productivity and Standardization
Exploring next-gen tools for Apache Spark development, focusing on productivity, code standardization, metadata, lineage, and CI/CD agility to overcome limitations of traditional ETL tools.
Reliable Pipelines and High Quality Data Without the Toil - Kyle Kirwan
Explore data observability's power in enhancing pipeline quality, reducing maintenance toil, and optimizing performance. Learn key components: metrics, data, lineage, and alerts for effective data management.
The Data Pipelines Behind Forest Carbon Credits - Why Pachama Uses Flyte to Orchestrate Workflows
Explore how Pachama uses Flyte to manage complex data and ML pipelines for transparent forest carbon credit computation, including workload management, configuration, and lessons learned.
ETL Observability: Azure to Snowflake - Monitoring with Splunk and Power BI
Explore ETL monitoring from Azure to Snowflake using ADF, Splunk, and Power BI. Learn data lineage and observability techniques for efficient pipeline management.
Mastering Unity Catalog - Lessons from Zalando's Adoption Journey
Explore Zalando's journey in adopting Databricks Unity Catalog, overcoming challenges in a large-scale environment with diverse use cases, distributed schemas, and strict regulations to enhance data governance and productivity.
Open Sourcing Unity Catalog - Databricks
Explore Unity Catalog's open-source journey, its key features, and how it enhances data governance and management in the Databricks ecosystem.
Migrating Datasets to Unity Catalog for Accelerated Data Exploration
Learn how T-Mobile and Tredence migrated datasets to Unity Catalog, enhancing data management and access control for AI/ML use cases. Discover improved data ingestion processes and centralized governance.
Automating Airflow Backfills with Marquez
Learn to automate Airflow backfills using Marquez, enhancing data pipeline efficiency and reliability in complex workflows.
Data Discovery at Databricks with Amundsen - Improving Productivity and Trust
Explore how Databricks leverages Amundsen for efficient data discovery, improving productivity by surfacing relevant datasets, SQL dashboards, and metadata programmatically.
Scaling Data Preparation for Your Data-Centric AI Development
Explore scaling data preparation for AI development, covering DataOps, versioning, labeling, and automating workflows into robust pipelines for efficient ML operationalization.
Truly Open Lineage - Building Trust in AI Models Through Data Provenance
Explore open-source ecosystem for data lineage, combining Egeria, OpenLineage, and Marquez to enhance trust in AI models through transparent data origin and processing tracking.
Unity Catalog and Purview - Data Governance Integration
Explore data lineage from Databricks Unity Catalog in Microsoft Purview through hands-on demonstrations, enhancing your data governance capabilities.
Drive a Data Culture for Your Business on the Secure Foundation of Azure & Power BI
Empower data consumers with unified governance, automated discovery, and end-to-end lineage. Learn to create a holistic map of your data landscape while ensuring security and compliance.
Building Modern Data Pipelines with Spark on Azure HDInsight
Explore common patterns for building end-to-end data analytics pipelines using Apache Spark on Azure HDInsight, covering architecture, integration points, and various pipeline options.
Unified Data Governance with Azure Purview
Explore Azure Purview's innovative approach to unified data governance, including automated discovery, lineage extraction, and centralized access control for cloud-scale data estates across various systems.