Delta Merge Optimizations with Jodie Helpers
Explore Delta Merge optimization strategies, including data skipping and Change Data Feed implications, to enhance performance and handle failure scenarios in data lakehouse environments.
Power Up Your Lakehouse with Git Semantics and Delta Lake
Enhance data versioning in lakehouses using Delta Lake and lakeFS, enabling git-like semantics for improved time travel, data quality, and operational economics.
Securely Running Databricks on AWS for Public Sector and Regulated Industries
Explore secure Databricks deployment on AWS for regulated industries, covering compliance, encryption, data governance, and workflow orchestration for stringent security requirements.
Seamless Flow: Evolving From Batch to Streaming Data Flows Using DLT
Explore how 84.51° leverages Delta Live Tables to evolve data flows from batch to streaming, combining real-time and historical data for enhanced retail insights and customer-centric strategies.
Delivering Portability to Open Data Lakes with Delta Lake UniForm
Explore Delta Lake UniForm's solution for enhancing data lake reliability, performance, and governance across multiple environments. Learn best practices for scaling and optimizing cloud-based data lakes.
The Data Lakehouse for Streaming Data - A Talk for Everyone Who Loves Data
Explore data lakehouses: combining data lakes and warehouses for reliable, flexible data management. Learn about open-source projects, streaming data support, and see a live Twitter sentiment analysis demo.
The Data Lakehouse - A Tech Talk for Everyone Who Loves Data
Explore data lakehouses: combining data lakes and warehouses for reliability, governance, and flexibility. Learn about open-source projects, streaming data, and future improvements through live demos and code examples.
Open Data Foundations Across Hudi, Iceberg and Delta - OneTable Integration
Explore OneTable's innovative approach to optimizing data across Hudi, Iceberg, and Delta Lake. Learn how it enhances workloads for various query engines and streamlines data analysis.
Data Governance and Data Lake Implementation with Delta Lake
Discover how to effectively implement Data Lake with Data Governance through Microsoft's key services, featuring real SK case studies and insights on ML Studio and Power BI integration.
The Intelligent Future of Data Warehouses and Delta Lake - Structured Streaming with PySPARK
Explore the evolution of data warehousing from traditional ETL to modern Lakehouse architecture, focusing on Delta Lake, Structured Streaming, and PySpark implementation with practical code examples.
Overview of the Databricks Platform and Data Lakehouse Architecture
Discover how Databricks revolutionizes data processing by combining data warehouse and lake architectures through Delta Lake, Apache Spark, MLFlow, and Koalas frameworks for scalable data engineering and analytics.
Understanding Microsoft Fabric - Video 2
Explore Microsoft Fabric's architecture, services, and key concepts for self-service data analytics and AI, building on UI basics from the previous video.
Building a Lakehouse on the Microsoft Intelligent Data Platform
Explore Lakehouse architecture on Microsoft Intelligent Data Platform. Learn Synapse Analytics, Delta format, and Spark-based engines for efficient big data processing and analytics.
Building Data Lakehouse from Scratch - End-to-End Data Engineering Project
Design, implement, and maintain scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Enhance data potential through advanced analytics and machine learning.
Getting Started with Delta Lake on Databricks
Explore Delta Lake's optimized data storage in Databricks, enhancing query performance and enabling time travel while reducing system complexity.
The Emerging Toolkit for Reliable, High-quality LLM Applications
Explore emerging techniques in LLMOps for building, tuning, and maintaining high-quality LLM applications. Learn about testing tools, programming frameworks, and methods to control LLM outputs for desired goals.
Streaming Data Pipelines From Supernovas to LLMs
Hands-on tutorial for building real-time data pipelines using Databricks, from ingesting NASA supernova data to implementing LLMs with RAG. Covers ETL, stream processing, and natural language analytics.
AT&T's Journey Towards a Serverless Data Intelligence Platform
Explore AT&T's evolution on Databricks Platform, scaling data projects with automated pipelining, serverless SQL warehouses, and AI/ML use cases while meeting security and regulatory requirements.
How to Make Money Betting on NBA Using Rocket Science
Explore how Kalman filters, used in rocket science, are applied to NBA betting predictions. Learn about DraftKings' data-driven approach to generate accurate probabilities for bookmaking.
From Excel to Real-Time Insights Using Databricks, ThoughtSpot and Power BI
Transforme relatórios estáticos em insights em tempo real usando Databricks, ThoughtSpot e Power BI. Aprenda a construir uma plataforma de análise avançada para capacitar gerentes e analistas com dados atualizados.
How to Migrate from Snowflake to an Open Data Lakehouse Using Delta Lake UniForm
Explore Delta Lake UniForm's ability to create a single data set accessible across multiple open table formats, enhancing data lakehouse architecture efficiency and flexibility.