Building an Open Data Lakehouse Using Apache Spark, Apache Iceberg and Dremio
Explore the evolution of big data to data lakehouses, focusing on open architecture development, security, governance, and augmentation using Dremio, Apache Spark, and Apache Iceberg.
Timespan Fact Tables: Handling Historical Data in Data Warehousing
Explore practical applications of Timespan Fact Tables for handling historical data, including row effective dates, expiration dates, and current row indicators.
Introducing Your Databricks Flight Assistant - Lakehouse AI Copilot
Explore Databricks' Lakehouse Assistant: Chat in English to generate SQL queries, scripts, and code explanations while navigating the Lakehouse with ease.
Take a Self-Taught Journey into the World of Data
Discover how to transition from teaching to data analytics through self-learning, leveraging community support in the tech industry.
Spark SQL Shuffle Join Optimization at eBay
Optimize Spark SQL shuffle join performance with advanced techniques like unwrapping join conditions, enhancing shuffle exchange reuse, and pushing down partial aggregations.
Snowflake Data Warehouse Internals - Lecture 21
Explore Snowflake's data warehouse architecture, design principles, and internal mechanisms for efficient cloud-based data management and analytics.
Accelerating Apache Spark Workloads with Apache DataFusion Comet
Explore Apache DataFusion Comet's potential to enhance Apache Spark performance, optimizing data processing workflows and improving efficiency in large-scale analytics.
Apache Arrow DataFusion - A Fast, Embeddable, Modular Analytic Query Engine
Explore Apache Arrow DataFusion's fast, embeddable, and modular analytic query engine capabilities with insights from expert Andrew Lamb.
Yellowbrick Data Warehouse System - Lecture 21
Explore Yellowbrick's innovative data warehouse system, its architecture, and performance optimizations for analytical workloads in this advanced database systems lecture.
Snowflake Data Warehouse Internals - Lecture 19
Explore Snowflake's data warehouse architecture, design principles, and internal workings. Gain insights into its innovative approach to cloud-based data management and analytics.
ETL Observability: Azure to Snowflake - Monitoring with Splunk and Power BI
Explore ETL monitoring from Azure to Snowflake using ADF, Splunk, and Power BI. Learn data lineage and observability techniques for efficient pipeline management.
Understanding the SQL Aspects of Spark - Spark SQL
Explore Spark SQL's capabilities for distributed processing of structured data, integrating relational operations with Spark's high-performance engine.
Introduction to Data Build Tool (DBT)
Master data build tool (DBT) for efficient data product development, including CICD, pipelines, validation, quality testing, deployment, and monitoring.
Real-Time Data Integration Practice Based on Flink CDC at Alibaba Cloud
Explore real-time data integration using Flink CDC, covering core design, key implementations, and Alibaba Cloud's solutions for data lake and warehouse integration scenarios.
Cloud Agnostic Data Platform with DBT, Trino, Iceberg and MinIO
Explore a hands-on, cloud-agnostic data pipeline using TrinoDB, DBT, MinIO, and Apache Iceberg for scalable and lightweight analytics, suitable for both cloud and on-premise solutions.
DBT and Python - How to Write Reusable and Testable Pipelines
Develop reusable and testable data pipelines using DBT and Python. Learn best practices for version control, DAGs, and unit testing in SQL and Python-based models.
chDB - The Blazing Fast SQL Engine for Data Science
Explore chDB, a high-performance SQL engine for Python data ecosystem. Leverage its extensive data source support, ANSI SQL compliance, and seamless integration with popular libraries for efficient data analysis.
Building Data Applications on Databricks in 20 Minutes
Learn to create data apps for non-technical users, enabling data-driven decisions. Explore rapid app development using Python frameworks, data access methods, security, governance, and production deployment on Databricks.
Getting Started with Databricks Clean Rooms
Explore privacy-safe data collaboration using Databricks Clean Rooms. Learn to analyze shared data, train ML models, enforce privacy policies, and enable advanced use cases across platforms.
Data Warehousing Performance, Scale and Security with Databricks SQL
Explore high-performance data warehousing with Databricks SQL, focusing on scalability, security, and resource management for enterprise environments. Learn about latest advancements in scheduling and caching.
Maximizing Productivity with Databricks Assistant - Key Strategies and Tips
Discover how Databricks Assistant enhances productivity through AI-powered code creation, optimization, and troubleshooting. Learn to leverage natural language for SQL, Python, and data visualization while ensuring privacy and security.