Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#ETL Pipelines

Showing: 13 courses
Databricks

Designing and Implementing a Real-time Data Lake with Dynamically Changing Schema

0 rewiews
Learn to build a robust streaming ETL pipeline that handles dynamically changing schemas and new event types without downtime, using Delta Lake and Databricks for real-time data lake implementation.
Add to list
12 Lesons
25 minutes
On-Demand
Free-Video
Databricks

Modern ETL Pipelines with Change Data Capture - Building Resilient Data Streams

0 rewiews
Discover how GetYourGuide built a resilient ETL pipeline using Debezium, Kafka, Spark, and Airflow. Learn to handle schema changes automatically, stream data from SQL databases, and refresh data lakes multiple times daily for fresher insights.
Add to list
25 Lesons
43 minutes
On-Demand
Free-Video
CodeWithYu

Realtime Stock Market Anomaly Detection Using Machine Learning - End-to-End Data Engineering Project

0 rewiews
Develop an end-to-end data engineering project for real-time stock market anomaly detection using Quix Streams, Redpanda, and Docker. Learn to build a complete data pipeline and deploy an advanced ML model.
Add to list
10 Lesons
1 hour 2 minutes
On-Demand
Free-Video
SQLBits

Delta Live Tables - Building Reliable ETL Pipelines with Azure Databricks

0 rewiews
Build fast, reliable, and scalable ETL pipelines using Delta Live Tables on Azure Databricks. Learn declarative approaches and see demos of simple and complex streaming pipelines.
Add to list
9 Lesons
49 minutes
On-Demand
Free-Video
Linux Foundation

Lessons Learned from the Migration to Apache Airflow

0 rewiews
Explore Apache Airflow for orchestrating complex workflows, with insights on ETL pipelines, Spark integration, and best practices for managing big data infrastructure.
Add to list
14 Lesons
38 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Product Recommendation System on Kubernetes Using Argo Workflows

0 rewiews
Learn to build a product recommendation system using Argo Workflows on Kubernetes. Explore DataOps, pipelines, and tools like Minio and Apache Spark for efficient data processing and analysis.
Add to list
1 Lesons
29 minutes
On-Demand
Free-Video
Databricks

Improving Broadcast Joins in Apache Spark SQL

0 rewiews
Discover techniques to enhance broadcast joins in Apache Spark SQL, including executor-side broadcasting and memory optimization, for improved performance in large-scale ETL pipelines and complex data processing tasks.
Add to list
10 Lesons
28 minutes
On-Demand
Free-Video
Linux Foundation

Breakdown New Data Silos in Generative AI

0 rewiews
Explore strategies to overcome data silos in generative AI, enhancing model performance through improved data access, discovery, and integration across departments and cloud platforms.
Add to list
1 Lesons
37 minutes
On-Demand
Free-Video
Strange Loop Conference

Building a Unified Cancer Immunotherapy Data Library

0 rewiews
Explore a unified cancer immunotherapy data library leveraging Datomic for efficient storage, querying, and collaboration. Learn about CANDEL's innovative approach to managing complex research data.
Add to list
30 Lesons
46 minutes
On-Demand
Free-Video
PyCon US

Too Big for DAG Factories?

0 rewiews
Learn to scale data workflows using Apache Airflow, covering dynamic DAG generation, automation, and best practices for managing big data pipelines. Suitable for beginners and intermediate developers.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
PASS Data Community Summit

Building Modern Data Pipelines with Spark on Azure HDInsight

0 rewiews
Explore common patterns for building end-to-end data analytics pipelines using Apache Spark on Azure HDInsight, covering architecture, integration points, and various pipeline options.
Add to list
26 Lesons
1 hour 18 minutes
On-Demand
Free-Video
Data Science Conference

How Bosch Power Tools Leverages User Data and AI for Consumer Feedback and ETL Pipeline Management

0 rewiews
Discover how Bosch Power Tools harnesses AI and data analytics to process consumer feedback, maintain language consistency, and optimize ETL pipelines for enhanced customer satisfaction.
Add to list
1 Lesons
23 minutes
On-Demand
Free-Video
CodeWithYu

Realtime Data Streaming - End-to-End Data Engineering Project

0 rewiews
Build a real-time data streaming pipeline using Apache Airflow, Kafka, Spark, and Cassandra. Learn end-to-end data engineering, from ingestion to processing and storage, all containerized with Docker.
Add to list
8 Lesons
1 hour 28 minutes
On-Demand
Free-Video