Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#ETL

Showing: 131 courses
MLOps.community

The Daft Distributed Python Data Engine: Multimodal Data Curation at Any Scale

0 rewiews
Explore the Daft distributed Python data engine for multimodal data curation at any scale in this 27-minute talk by Jay Chia. Discover how Daft addresses the fundamental needs of ML/AI data platforms, including terabyte-scale ETL with complex model batch…
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
Dynatrace

Anomaly Detection on 5 Pillars of Data Observability with Dynatrace Davis AI

0 rewiews
Explore Dynatrace Davis AI's anomaly detection for data observability pillars: freshness, distribution, volume, schema, and lineage. Learn automation techniques for alerting and monitoring data integrity.
Add to list
8 Lesons
34 minutes
On-Demand
Free-Video
MLOps World: Machine Learning in Production

Parallelizing Your ETL with Dask on Kubeflow

0 rewiews
Leverage Dask's parallelism capabilities on Kubeflow for advanced ETL processing. Learn to use the Dask Operator to optimize resource utilization in interactive Jupyter sessions and pipeline workflows.
Add to list
1 Lesons
1 hour 48 minutes
On-Demand
Free-Video
Great Learning

Big Data Analytics for Beginners

0 rewiews
Comprehensive introduction to big data analytics, covering key concepts like Hadoop, Apache Spark, and ETL. Ideal for beginners seeking to understand the landscape and value chain of big data.
Add to list
8 Lesons
1 hour 11 minutes
On-Demand
Free-Video
Microsoft

Smart Data Pipelines to Azure - Ingesting and Migrating Data the DataOps Way

0 rewiews
Explore StreamSets' DataOps platform for optimizing data ingestion and migration to Azure. Learn about smart data pipelines, integration with Azure services, and how to speed up cloud adoption using modern data engineering practices.
Add to list
12 Lesons
30 minutes
On-Demand
Free-Video
SAP

Strategy and Latest Updates for Data Integration at SAP

0 rewiews
Explore SAP's data integration strategy, focusing on SAP Data Intelligence's role in orchestrating complex data landscapes and powering the Business Technology Platform for effective hybrid data management.
Add to list
20 Lesons
45 minutes
On-Demand
Free-Video
The ASF

Building a Lakehouse with Apache Hudi - Data Architecture at Kuaishou

0 rewiews
Discover how Kuaishou Inc implements Apache Hudi to build a robust lakehouse architecture, exploring real-world applications and technical insights for large-scale data management.
Add to list
1 Lesons
48 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Running Remote Shuffle Service to Solve Apache Spark's Dynamic Resource Allocation Challenge on Kubernetes

0 rewiews
探讨利用远程洗牌服务解决Apache Spark在Kubernetes上的动态资源分配挑战,实现存储与计算解耦,提高大数据处理的可靠性和可扩展性。
Add to list
1 Lesons
54 minutes
On-Demand
Free-Video
PyCon US

SQL está en todas partes: Explorando alternativas con Ibis

0 rewiews
Descubre Ibis: una biblioteca Python para consultas de datos eficientes en múltiples backends. Simplifica el trabajo con bases de datos SQL y ofrece una alternativa a las complejas consultas tradicionales.
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
Security BSides San Francisco

Reinventing ETL for Detection and Response Teams

0 rewiews
Explore innovative strategies for efficient, cost-effective data collection and log enrichment tailored to Detection and Response teams' unique requirements in cybersecurity.
Add to list
1 Lesons
29 minutes
On-Demand
Free-Video
Anyscale

Supercharging ETL and Analytics with Ray and Daft

0 rewiews
Discover how Daft library enhances Ray clusters with distributed ETL capabilities, enabling seamless data processing, analytics, and ML/AI integration for scalable, high-performance workflows.
Add to list
1 Lesons
11 minutes
On-Demand
Free-Video
OSACon

ETL with Meltano and Singer in the LLM Era

0 rewiews
Explore how traditional ETL tools like Singer and Meltano can enhance data pipeline management for LLM applications, addressing production-level challenges beyond basic LangChain capabilities.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
OSACon

Navigating the Landscape of a Fully Open Source Data Stack in 2023

0 rewiews
Explore the architecture of modern data stacks, from warehousing to streaming solutions, while understanding the potential and limitations of open-source tools in today's data infrastructure.
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
OSACon

Unveiling the Power of dbt and DuckDB - Hype vs Reality

0 rewiews
Explore the practical applications and limitations of combining dbt and DuckDB for data transformations, examining real-world use cases and performance considerations.
Add to list
1 Lesons
20 minutes
On-Demand
Free-Video
OSACon

The Real Modern Data Stack - Building ETL Pipelines with Open Source Tools

0 rewiews
Discover how to build powerful, cost-effective ETL data stacks using open-source tools like sling, dbt, duckdb, and dagster - transforming months of implementation into rapid deployment.
Add to list
1 Lesons
21 minutes
On-Demand
Free-Video
Prodramp

Data Engineering and Storage Concepts - With ETL, ELT, Warehouse, Lake, and Lake House

0 rewiews
Comprehensive overview of data engineering concepts, including storage solutions, ETL/ELT processes, and modern data architectures like data mesh, with practical examples and best practices for effective data management.
Add to list
19 Lesons
27 minutes
On-Demand
Free-Video
Databricks

Empowering Developers with Self-Service ETL - Zillow's Approach

0 rewiews
Zillow's self-service ETL solutions empower teams to build, maintain, and monitor data pipelines, abstracting complex processes and catering to diverse user needs while leveraging internal services for efficient implementation.
Add to list
17 Lesons
24 minutes
On-Demand
Free-Video
Databricks

Code Once, Use Often - Declarative Data Pipelines

0 rewiews
Learn to build efficient, reusable data pipelines using declarative approaches. Explore techniques for reducing food waste through data-driven solutions and automation in this developer-focused session.
Add to list
21 Lesons
28 minutes
On-Demand
Free-Video
Databricks

Make Reliable ETL Easy on Delta Lake

0 rewiews
Learn to simplify ETL development on Delta Lake, improving data quality and scaling operations. Discover how Databricks streamlines the ETL lifecycle for efficient data engineering and management.
Add to list
14 Lesons
45 minutes
On-Demand
Free-Video
Databricks

Designing the Next Generation of Data Pipelines with Apache Spark - Zillow's Approach

0 rewiews
Zillow's data engineering team shares their journey in redesigning data pipelines using Apache Spark, focusing on scalability, maintainability, and robustness while reducing code complexity.
Add to list
9 Lesons
27 minutes
On-Demand
Free-Video
Databricks

Data Quality Tools Comparison for Continuous Data Imports

0 rewiews
Comparison of open-source data quality tools for continuous imports, covering maturity, documentation, extensibility, and features like data profiling and anomaly detection.
Add to list
17 Lesons
28 minutes
On-Demand
Free-Video
Databricks

Migrating ETL Workflows to Apache Spark at Scale - Pinterest's Experience

0 rewiews
Explore Pinterest's journey migrating ETL workflows to Apache Spark, covering challenges, solutions, and performance improvements. Learn about semantic gaps, thrift objects, and innovative Spark profiling techniques.
Add to list
23 Lesons
25 minutes
On-Demand
Free-Video
Databricks

Delta Live Tables: Modern Software Engineering for ETL Pipelines

0 rewiews
Learn how Delta Live Tables simplifies ETL, enhances data pipeline reliability, and automates tasks. Discover modern software engineering practices for efficient data transformation and improved analytics, data science, and ML outcomes.
Add to list
18 Lesons
36 minutes
On-Demand
Free-Video
Databricks

Re-Imagining Apache Spark Development - Tools for Productivity and Standardization

0 rewiews
Exploring next-gen tools for Apache Spark development, focusing on productivity, code standardization, metadata, lineage, and CI/CD agility to overcome limitations of traditional ETL tools.
Add to list
14 Lesons
25 minutes
On-Demand
Free-Video
Databricks

Different Streaming Methods with Apache Spark and Kafka

0 rewiews
Explore real-time analytics using Apache Spark and Kafka. Learn about streaming methods, overcoming technical challenges, and innovative solutions for handling billions of daily events in a scalable, cost-efficient manner.
Add to list
10 Lesons
34 minutes
On-Demand
Free-Video
Databricks

Orchestration Made Easy with Databricks Workflows

0 rewiews
Discover Databricks Workflows: a managed orchestration service for streamlined data pipelines. Learn to create, run, and monitor reliable workflows, implement recovery actions, and explore new features for efficient data management.
Add to list
11 Lesons
35 minutes
On-Demand
Free-Video
Databricks

Healthcare Claim Reimbursement Using Apache Spark - Optum's System Transformation

0 rewiews
Optimizing healthcare claim processing with Apache Spark: Improved performance, reduced costs, and enhanced capabilities for hospitals' revenue recovery through efficient data processing and analysis.
Add to list
14 Lesons
49 minutes
On-Demand
Free-Video
Databricks

Building the Petcare Data Platform with Delta Lake and Spark ETL Pipeline

0 rewiews
Explore Mars Petcare's data platform using Delta Lake and Spark ETL pipeline 'Kyte'. Learn about advantages over Azure Data Factory and leveraging Delta Lake for ETL configurations and data science.
Add to list
7 Lesons
27 minutes
On-Demand
Free-Video
Databricks

Using Apache Spark for Predicting Degrading and Failing Parts in Aviation

0 rewiews
Leveraging Apache Spark for predictive maintenance in aviation, enabling efficient data processing, anomaly detection, and component health scoring to improve fleet readiness and prevent failures.
Add to list
17 Lesons
28 minutes
On-Demand
Free-Video
Databricks

Faster Data Integration Pipeline Execution Using Spark-Jobserver

0 rewiews
Optimize data integration pipelines using Spark-Jobserver for faster execution, context reuse, and efficient resource management. Learn configuration, security, and API integration for improved performance.
Add to list
30 Lesons
32 minutes
On-Demand
Free-Video
Linux Foundation

Accelerating Spark Workloads in a Mesos Environment with Alluxio

0 rewiews
Learn how Alluxio enhances Spark and Mesos performance by providing memory-speed data access across disparate storage systems, optimizing big data processing and enabling new workloads.
Add to list
1 Lesons
35 minutes
On-Demand
Free-Video
Linux Foundation

Building Modern Data Streaming Apps with Open Source

0 rewiews
Discover best practices for building data streaming applications using open-source frameworks. Learn to orchestrate streams, perform ETL, enhance events, and make continuous queries with tools like Apache NiFi, Pulsar, Spark, and Flink SQL.
Add to list
1 Lesons
47 minutes
On-Demand
Free-Video
Linux Foundation

Accelerating Spark Workloads in an Apache Mesos Environment with Alluxio

0 rewiews
Learn how Alluxio enhances Spark and Mesos performance by providing memory-speed data access across diverse storage systems, optimizing big data processing and enabling new workloads.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
Linux Foundation

Building Robust Streaming Data Pipelines with Apache Spark

0 rewiews
Learn to build robust streaming data pipelines using Apache Spark, Kafka, and Camel. Explore ETL challenges, data management, and lessons from running these technologies in Docker.
Add to list
15 Lesons
42 minutes
On-Demand
Free-Video
Visual Studio Code

Streamlining Data Preparation with Pydantic - A 25-Minute Guide

0 rewiews
Explore Pydantic's power in data validation and cleaning for Python projects. Learn to ensure consistency, handle missing values, and streamline data preparation in just 25 minutes.
Add to list
12 Lesons
27 minutes
On-Demand
Free-Video
SQLBits

Power Query in 20 Minutes - How it Works

0 rewiews
Explore Power Query's internals and gain a deeper understanding of this increasingly prevalent tool in Power BI and Fabric technologies.
Add to list
1 Lesons
19 minutes
On-Demand
Free-Video
NashKnolX

ETL Observability: Azure to Snowflake - Monitoring with Splunk and Power BI

0 rewiews
Explore ETL monitoring from Azure to Snowflake using ADF, Splunk, and Power BI. Learn data lineage and observability techniques for efficient pipeline management.
Add to list
1 Lesons
48 minutes
On-Demand
Free-Video
NashKnolX

Data Engineering with Databricks - Leveraging the Lakehouse Platform for ETL Pipelines

0 rewiews
Leverage Databricks Lakehouse Platform to build ETL pipelines, use Delta Live Tables, and orchestrate tasks with Workflows for efficient data processing.
Add to list
1 Lesons
44 minutes
On-Demand
Free-Video
NashKnolX

Implementing Change Data Capture (CDC) and Slowly Changing Dimensions (SCD) Using Spark and Hive

0 rewiews
Learn to implement Change Data Capture (CDC) and Slowly Changing Dimension (SCD) patterns in Hive using Spark, with a step-by-step guide for efficient data management and analysis.
Add to list
1 Lesons
1 hour 1 minute
On-Demand
Free-Video
Shaw Talebi

How to Build Data Pipelines for ML Projects with Python Code

0 rewiews
Learn to build data pipelines for machine learning projects using Python. Explore ETL vs ELT, extraction, transformation, loading, and orchestration. Includes practical example of processing YouTube video transcripts.
Add to list
10 Lesons
23 minutes
On-Demand
Free-Video
Shaw Talebi

Automating Data Pipelines with Python and GitHub Actions - Code Walkthrough

0 rewiews
Automate data pipelines using Python and GitHub Actions. Learn to create ETL scripts, set up repositories, configure workflows, and implement ML applications for efficient data processing.
Add to list
13 Lesons
31 minutes
On-Demand
Free-Video
The ASF

Challenges and Solutions for Building Real-time Data Warehousing with Apache Flink, Apache Hive and Apache Iceberg

0 rewiews
Explore solutions for real-time data warehousing using Apache Flink, Hive, and Iceberg. Learn to handle challenges like late events and dirty data routing in enterprise-level ETL migration.
Add to list
1 Lesons
36 minutes
On-Demand
Free-Video
Toronto Machine Learning Series (TMLS)

Reaching Lightspeed Data Science - ETL, ML, and Graph with NVIDIA RAPIDS

0 rewiews
Accelerate data science workflows using GPUs and RAPIDS. Learn performance gains, easy migration, and new possibilities in ETL, ML, and graph analytics.
Add to list
1 Lesons
1 hour 19 minutes
On-Demand
Free-Video
Databricks

Uber's Batch Analytics Evolution from Hive to Spark

0 rewiews
Explore Uber's strategic migration from Hive to SparkSQL for batch analytics, including automation features, challenges faced, and efficiency gains achieved in this data processing evolution.
Add to list
1 Lesons
28 minutes
On-Demand
Free-Video
Databricks

Building a Multimodal Data Lakehouse with the Daft Distributed Python Dataframe

0 rewiews
Explore Daft, a next-gen distributed query engine for processing multimodal data at scale. Learn to build a multimodal data lakehouse using familiar dataframe interfaces on existing infrastructure.
Add to list
1 Lesons
18 minutes
On-Demand
Free-Video
Databricks

Moving from SAP Business Warehouse to Databricks - Insurance Company Case Study

0 rewiews
Explore an insurance company's migration from SAP BW to Databricks, highlighting improved performance, automated ETL, enhanced self-service, and cost reduction. Learn insights and future possibilities.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
CodeWithYu

Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project

0 rewiews
Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.
Add to list
13 Lesons
2 hours 9 minutes
On-Demand
Free-Video
SQLBits

The Metadata-Driven Data Warehouse

0 rewiews
Streamline data warehouse development using metadata-driven approaches. Learn efficient techniques for Insert/Update/Delete operations and pipeline management.
Add to list
1 Lesons
45 minutes
On-Demand
Free-Video
SQLBits

Query Folding in Power Query: Importance for Performance

0 rewiews
Discover query folding's importance for Power Query performance and learn factors that can hinder its effectiveness.
Add to list
1 Lesons
21 minutes
On-Demand
Free-Video
SQLBits

Building Tomorrow's Warehouse Today - Modern Data Warehouse Modelling Insights

0 rewiews
Explore fundamental shifts in data warehousing architecture and processing design principles for modern, efficient data management and analysis.
Add to list
1 Lesons
42 minutes
On-Demand
Free-Video
SQLBits

How to Pick the Best Data Transformation Strategy

0 rewiews
Explore tools for combining data from multiple sources, including Azure Synapse, Spark, and Power BI Data Flows. Learn to select the optimal tool for your data environment.
Add to list
1 Lesons
47 minutes
On-Demand
Free-Video
SQLBits

Declarative ETL Pipelines with Delta Live Tables - Modern Software Engineering for Data Analysts and Engineers

0 rewiews
Modernize ETL pipelines using Delta Live Tables for efficient data management. Learn development, production, and best practices for reliable, testable, and scalable data processing.
Add to list
14 Lesons
51 minutes
On-Demand
Free-Video
Data Science Conference

Introduction to Orchestrating ETL Processes with Apache Airflow

0 rewiews
Master Apache Airflow's workflow management capabilities for ETL processes through practical examples. Learn core concepts like DAGs, Tasks, Variables, and XComs while building efficient data engineering pipelines.
Add to list
1 Lesons
1 hour 59 minutes
On-Demand
Free-Video
Bryan Cafferky

Master Azure Automation - The Azure Automation Service

0 rewiews
Learn to automate tasks in Azure using Automation Accounts. Explore job scheduling, runbooks, configuration management, and PowerShell modules for efficient cloud operations.
Add to list
19 Lesons
57 minutes
On-Demand
Free-Video
Linux Foundation

Apache Kafka and the Rise of the Streaming Platform

0 rewiews
Explore streaming platforms with Apache Kafka as the core, revolutionizing data flow management. Learn how this technology acts as a central nervous system for modern digital businesses.
Add to list
1 Lesons
20 minutes
On-Demand
Free-Video
Big Data Demystified

Rise, Fall and Re-Rise of the Semantic Layer - Evolution and Future of Data Management

0 rewiews
Explore the evolution of semantic layers in data management, from traditional systems to modern metric stores, while understanding key challenges and future directions in data truth management.
Add to list
1 Lesons
32 minutes
On-Demand
Free-Video
Open Data Science

Leveraging Large Language Models for ETL, Analytics, and Modern Data Stack

0 rewiews
Discover how Large Language Models revolutionize data workflows, from ETL processes to analytics automation, with practical insights on implementation challenges and production deployment strategies.
Add to list
6 Lesons
21 minutes
On-Demand
Free-Video
The ASF

Building an Integrated Data Asset Platform with Apache DolphinScheduler - DataOps Track

0 rewiews
Discover how Apache DolphinScheduler powers Unicom Digital Technology's integrated data asset platform, exploring key features and implementation strategies for efficient data operations.
Add to list
1 Lesons
37 minutes
On-Demand
Free-Video
Discover AI

Experimental KERAS Feature Space for Medical AI Heart Attack Prediction

0 rewiews
Dive into advanced feature scaling with KERAS Feature Space, building a medical AI system to predict heart attack probabilities using structured data classification and optimized data pipelines.
Add to list
6 Lesons
36 minutes
On-Demand
Free-Video
Conf42

Solving Migration Pipelines

0 rewiews
Explore strategies for solving migration pipeline challenges in cloud-native environments, focusing on efficiency and scalability.
Add to list
2 Lesons
18 minutes
On-Demand
Free-Video
Databricks

Building a Petabyte-Scale Cybersecurity Data Mesh in Azure with Delta Lake - HSBC Case Study

0 rewiews
Explore HSBC's innovative approach to building a petabyte-scale cybersecurity data mesh in Azure, leveraging Delta Lake to address unique challenges and empower analysts with a unified, scalable platform.
Add to list
22 Lesons
33 minutes
On-Demand
Free-Video
Great Learning

Data Engineering Roadmap and Full Course with Python and SQL for 2024

0 rewiews
Comprehensive guide to data engineering, covering Python, SQL, big data technologies, cloud platforms, and data warehousing tools. Includes hands-on tutorials and real-world projects for practical skill development.
Add to list
46 Lesons
10 hours 32 minutes
On-Demand
Free-Video
PASS Data Community Summit

Managing ETL Change Using BIMLScript

0 rewiews
Automate ETL processes using BIMLScript and metadata to easily adapt to source file changes, demonstrated with US census data and applicable to SSIS and Azure Data Factory.
Add to list
1 Lesons
1 hour 15 minutes
On-Demand
Free-Video
SF Python

Data Pipeline Scorecard: Evaluating Python Processing Approaches

0 rewiews
Explore data processing approaches in Python, comparing different methods and their practical applications for building efficient data pipelines and optimizing workflow performance.
Add to list
1 Lesons
29 minutes
On-Demand
Free-Video
NashKnolX

Kafka Connectors: Introduction to Kafka Connect Framework

0 rewiews
Explore Kafka Connect framework for integrating Kafka with external systems, focusing on cluster setup and connector functionality.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
NashKnolX

Azure Data Factory: Cloud ETL Service for Data Integration and Transformation

0 rewiews
Master Azure Data Factory for serverless data integration and transformation, with code-free UI and SSIS compatibility.
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
Data Council

Charting the Lakehouse Trail: A Data Migration Adventure

0 rewiews
Explore a data migration journey from legacy warehouse to modern lakehouse. Gain insights on overcoming challenges and achieving seamless transitions for your organization.
Add to list
1 Lesons
14 minutes
On-Demand
Free-Video
SK AI SUMMIT 2024

SQL 엔진을 더욱 강력하게 - 비정형 데이터 분석 정상에 서다

0 rewiews
Discover how SK Hynix transforms unstructured semiconductor equipment data into structured formats using TrinoPy+, an enhanced SQL solution that enables seamless data preprocessing, analysis, and loading with single SQL queries.
Add to list
1 Lesons
18 minutes
On-Demand
Free-Video
SK AI SUMMIT 2024

Building Mobility Data Platform with EMR and Airflow

0 rewiews
Discover how to build and optimize a mobility data platform using AWS EMR and Airflow, focusing on migration strategies, cost optimization, and infrastructure automation with Terraform.
Add to list
1 Lesons
25 minutes
On-Demand
Free-Video
SK AI SUMMIT 2024

On-Premise Kubernetes and Airflow ETL Platform (Haflow) - Introduction and Implementation

0 rewiews
Discover SK하이닉스의 클라우드 네이티브 ETL 플랫폼 Haflow의 구축 사례와 아키텍처를 통해 기존 ETL 솔루션의 한계 극복 방안과 리소스 최적화 전략을 파악하세요.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
Conf42

Enriching the Data vs Filtering in Apache Spark

0 rewiews
Explore data enrichment vs filtering in Spark for improved performance and scalability in cloud-native applications, with practical examples and insights from Capital One's loyalty use case.
Add to list
14 Lesons
18 minutes
On-Demand
Free-Video
Conf42

Apache NiFi, Kafka, RisingWave, and Iceberg for Stock Data Processing with LLM - Conf42 Python 2024

0 rewiews
Explore stream processing with Apache NiFi, Kafka, RisingWave, and Iceberg. Learn real-time analytics, event-driven applications, and integrating stock data with LLMs in this comprehensive overview.
Add to list
13 Lesons
28 minutes
On-Demand
Free-Video
Conf42

Building Apache NiFi 2.0 Python Processors - Conf42 Python 2024

0 rewiews
Explore Apache NiFi 2.0 Python processors for data engineering, covering features, use cases, and real-time generative AI integration with a live demo.
Add to list
24 Lesons
29 minutes
On-Demand
Free-Video
SQLBits

Top 10 Azure Data Factory Tips and Tricks for Speed, Cost, and Performance

0 rewiews
Discover 10 essential Azure Data Factory tips to enhance performance, reduce costs, and streamline data integration solutions for improved efficiency.
Add to list
6 Lesons
21 minutes
On-Demand
Free-Video
SQLBits

Choosing Between Microsoft Fabric, Azure Synapse Analytics and Azure Data Factory

0 rewiews
Compare Microsoft Fabric, Azure Synapse Analytics, and Azure Data Factory to select the optimal Data Integration solution for your project. Gain insights on their strengths and limitations.
Add to list
1 Lesons
20 minutes
On-Demand
Free-Video
Confluent

Unlocking Real-Time Data Insights: Leveraging Confluent Cloud on Azure

0 rewiews
Leverage Confluent Cloud on Azure to build real-time data flows, capture changes instantly, and simplify data pipeline development. Boost productivity and innovate faster with streaming data pipelines and self-service access.
Add to list
1 Lesons
20 minutes
On-Demand
Free-Video
Data Council

Processing Trillions of Records with Mini Serverless Databases at Okta

0 rewiews
Explore serverless DuckDBs for efficient data processing, optimizing batch ETL, streaming, and SQL flexibility while addressing Kafka, latency, and ELT complexities in large-scale environments.
Add to list
4 Lesons
27 minutes
On-Demand
Free-Video
Databricks

Transforming Legacy Reporting to Cloud-Based BI Applications

0 rewiews
Streamlining 900+ legacy reports into a centralized cloud-based metric hub for TD's Personal Banking, enhancing data governance and cost-efficiency while providing a single source of truth.
Add to list
1 Lesons
17 minutes
On-Demand
Free-Video
Databricks

Architecture Analysis for ETL Processing - CPU vs GPU

0 rewiews
Explore GPU acceleration for ETL operations, comparing CPU and GPU architectures. Learn about performance gains in database operations and SQL query acceleration using GPUs.
Add to list
1 Lesons
19 minutes
On-Demand
Free-Video
Databricks

Integrating Informatica Cloud Data Integration with Databricks Unity Catalog

0 rewiews
Integrate Informatica Cloud with Databricks Unity Catalog for enhanced data quality, lineage tracking, and analytics. Learn to configure Databricks connectors in Informatica for seamless data ingestion and transformation.
Add to list
1 Lesons
22 minutes
On-Demand
Free-Video
Databricks

Fabricator - Streamlining Declarative Feature Engineering at DoorDash

0 rewiews
Découvrez comment DoorDash a développé Fabricator, un framework complet pour rationaliser l'ingénierie des caractéristiques déclaratives, orchestrant efficacement 1400 tâches quotidiennes et gérant 2,2 billions de valeurs.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
CodeWithYu

End-to-End Modern Data Engineering with DBT and BigQuery

0 rewiews
Master modern data engineering with DBT and BigQuery. Set up, link, transform data, convert tables to views, seed data, write tests, and generate documentation in this comprehensive tutorial.
Add to list
8 Lesons
30 minutes
On-Demand
Free-Video
Confluent

Next-Gen Data Modeling, Integrity, and Governance with YODA - Insights from Yotpo and ZipRecruiter

0 rewiews
Explore next-gen data modeling strategies for large-scale systems. Learn about YODA, an internal tool combining developer experience, DBT, Databricks, and more, to address data standardization and governance challenges.
Add to list
14 Lesons
56 minutes
On-Demand
Free-Video
Confluent

The Future of Streaming Data - Challenges and Opportunities

0 rewiews
Explore the future of streaming data, focusing on managing complex data connections, adopting Kafka internally, and addressing challenges in data governance, security, and movement across organizations.
Add to list
8 Lesons
42 minutes
On-Demand
Free-Video
Conf42

Optimizing Apache Spark and SQL for Improved Performance

0 rewiews
Enhance Apache Spark and SQL performance through optimization techniques. Learn strategies for improved efficiency in data processing and analysis.
Add to list
11 Lesons
30 minutes
On-Demand
Free-Video
SQLBits

Working with Data Using Azure Functions

0 rewiews
Explore Azure Functions for data interactions with Azure SQL, Cosmos DB, and Event Hubs. Learn to build lightweight, code-first APIs, integrations, ETL, and maintenance routines.
Add to list
1 Lesons
47 minutes
On-Demand
Free-Video
SF Python

Design Patterns for Data Pipelines Beyond ETL

0 rewiews
Discover essential design patterns for managing complex data pipelines in Python, focusing on advanced transformation techniques and Django integration for robust ETL workflows.
Add to list
1 Lesons
42 minutes
On-Demand
Free-Video
Tech Field Day

Qlik Talend Cloud - AI-Assisted Data Engineering Overview and Demo

0 rewiews
Discover how Qlik Talend Cloud revolutionizes data engineering with AI-assisted automation, no-code options, and advanced data integration capabilities for building robust, trustworthy data pipelines.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
NashKnolX

Introduction to Data Build Tool (DBT) - Features and Project Creation

0 rewiews
Master data transformation techniques with DBT (Data Build Tool) to effectively analyze and engineer warehouse data through hands-on project creation and fundamental features.
Add to list
1 Lesons
42 minutes
On-Demand
Free-Video
Discover AI

The Intelligent Future of Data Warehouses and Delta Lake - Structured Streaming with PySPARK

0 rewiews
Explore the evolution of data warehousing from traditional ETL to modern Lakehouse architecture, focusing on Delta Lake, Structured Streaming, and PySpark implementation with practical code examples.
Add to list
1 Lesons
32 minutes
On-Demand
Free-Video
Discover AI

DocETL: AI Agents for Complex Document Processing and Data Transformation

0 rewiews
Discover how DocETL framework leverages AI agents and LLMs to transform complex document processing, featuring innovative operators and optimization techniques for enhanced data extraction and analysis.
Add to list
9 Lesons
30 minutes
On-Demand
Free-Video
Data Science Conference

Practical Kimball Data Patterns for Machine Learning Data Warehousing

0 rewiews
Discover how dimensional modeling and Kimball patterns can streamline machine learning projects, reduce data preparation time, and improve ML model development through practical warehouse design techniques.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
Big Data Demystified

Airflow Distributed Workloads - ETL Architecture with AWS Lambda and Multi-Threaded Python Scripts

0 rewiews
Master distributed workload processing with Airflow, AWS Lambda, and multithreaded Python scripts while exploring ETL architecture for third-party API integration at scale.
Add to list
1 Lesons
53 minutes
On-Demand
Free-Video
Code Sync

A Year in Production with Machine Learning on the BEAM

0 rewiews
Explore insights on transitioning machine learning pipelines to Elixir, leveraging the Nx ecosystem for streamlined development and swift experimentation in production environments.
Add to list
1 Lesons
48 minutes
On-Demand
Free-Video
NashKnolX

Working with BigQuery and DataForm - Streamlining Data Management and Transformation

0 rewiews
Streamline data management with BigQuery and DataForm. Learn setup, optimization, and automation for efficient, scalable data pipelines and transformations.
Add to list
1 Lesons
41 minutes
On-Demand
Free-Video
Data Science Festival

Introduction to Data Engineering - Best Practices and Production-Level Infrastructure

0 rewiews
Learn best practices for scaling data science projects from local to production, covering infrastructure, reliability, and real-world applications in data engineering.
Add to list
1 Lesons
54 minutes
On-Demand
Free-Video
The ASF

Demystifying Apache Airflow - Separating Facts from Fiction

0 rewiews
Unpack critiques of Apache Airflow, analyze its strengths and weaknesses, debunk myths, and compare with competitors. Make informed decisions about workflow management platforms.
Add to list
1 Lesons
36 minutes
On-Demand
Free-Video
SQLBits

Azure Data Engineering Tools: Choosing Between Data Factory, Databricks, and Synapse Analytics

0 rewiews
Explore Azure data engineering tools: Data Factory, Databricks, and Synapse Analytics. Learn their strengths, use cases, and how to choose the right one for your project.
Add to list
43 Lesons
40 minutes
On-Demand
Free-Video
SQLBits

7 Things I Wish I'd Known Before Building a 60TB Data Warehouse on a Dedicated Pool

0 rewiews
Discover key insights and lessons learned from building a 60Tb data warehouse on Azure Dedicated Pool. Explore challenges, solutions, and best practices for large-scale data management.
Add to list
20 Lesons
41 minutes
On-Demand
Free-Video
SQLBits

Deep Skydiving into Data Factory in Microsoft Fabric

0 rewiews
Explore advanced Data Factory scenarios in Microsoft Fabric, leveraging Data Pipelines and Dataflows Gen2 for scalable implementations.
Add to list
1 Lesons
50 minutes
On-Demand
Free-Video