Data Engineering and Storage Concepts - With ETL, ELT, Warehouse, Lake, and Lake House
Comprehensive overview of data engineering concepts, including storage solutions, ETL/ELT processes, and modern data architectures like data mesh, with practical examples and best practices for effective data management.
Empowering Developers with Self-Service ETL - Zillow's Approach
Zillow's self-service ETL solutions empower teams to build, maintain, and monitor data pipelines, abstracting complex processes and catering to diverse user needs while leveraging internal services for efficient implementation.
Configuration-Driven Reporting on Large Datasets Using Apache Spark
Configurable enterprise framework for generating and distributing diverse reports from large financial datasets using Apache Spark, with dynamic scheduling and data transformation capabilities.
Delta Live Tables: Modern Software Engineering for ETL Pipelines
Learn how Delta Live Tables simplifies ETL, enhances data pipeline reliability, and automates tasks. Discover modern software engineering practices for efficient data transformation and improved analytics, data science, and ML outcomes.
Master Databricks and Apache Spark - SparkR Usage - Lesson 35
Explore SparkR for integrating R with Databricks and Apache Spark, covering architecture, APIs, libraries, and practical examples of data manipulation and analysis.
Predictive Maintenance on IoT Data for Early Fault Detection with Delta Lake
Explore predictive maintenance using IoT data and Delta Lake for early fault detection. Learn about Industry 4.0 applications, data analytics, and machine learning techniques for improved efficiency and cost savings.
Using Scikit-Learn Pipelines for Data Preprocessing with Python
Deep dive into Scikit-Learn Pipelines for efficient data preprocessing in Python, enhancing your machine learning workflow and streamlining model development.
Data Visualization in Python - Altair Data Preparation Techniques
Explore data preparation techniques in Altair for effective visualization, including aggregation, binning, time unit transforms, and filtering to shape and analyze your data effectively.
Data Preprocessing in Python
Learn to transform raw text into structured lists and CSVs using Python, enhancing data organization and analysis skills for practical applications.
End to End MLOPS Data Science Project Implementation With Deployment
Comprehensive MLOps project implementation covering data ingestion, validation, transformation, model training, and deployment on AWS EC2 using MLflow and GitHub Actions.
Microsoft Power BI Desktop for Beginners - 4-Step Tutorial
Comprehensive tutorial guiding beginners through Power BI Desktop, from installation to publishing. Learn data import, transformation, integration, and visualization techniques to create insightful dashboards.
Re-interpreting Data - Turning Files into Audio, Images, and Music
Explore unconventional data transformations using Ruby, turning files into audio, images, and music. Learn byte manipulation techniques while discovering creative ways to represent information.
Navigating a Full Stack Knowledge Architecture from Database to LLM
Explore the convergence of data, language, and wisdom in Full Stack Knowledge Architecture, combining LLM power with query language precision to navigate data through innovative access patterns.
Attempting to Tame the Data Beast: A BI Transition Tale
Explore the journey of modernizing a BI platform, from legacy systems to cutting-edge tools. Learn about data ingestion, dbt transformations, and Airflow orchestration, along with insights on overcoming challenges.
Leveraging Open-Source Tools for Building a Quality Data Warehouse
Discover how to build a quality data warehouse using open-source tools. Learn about modern data stack architecture, test-driven approaches, and software development best practices for data transformation.
Power Query in 20 Minutes - How it Works
Explore Power Query's internals and gain a deeper understanding of this increasingly prevalent tool in Power BI and Fabric technologies.
New Features of Apache NiFi - Tips and Techniques
Explore Apache NiFi's latest features, processors, and best practices. Build efficient data flows using cutting-edge techniques, with tips and guides for optimal implementation.
Big Data Transformation Powered by Apache Spark
Revolutionize data processing with Spark. Master transformative functions, aggregation, array manipulation, and advanced joins to unlock actionable insights from big data.
Data Engineering: A Deep Dive into Databricks
Master Databricks for efficient data processing, focusing on Apache Spark transformations, ingestion methods, storage, orchestration, and best practices to optimize data engineering workflows.
Introduction to Data Build Tool (DBT)
Master data build tool (DBT) for efficient data product development, including CICD, pipelines, validation, quality testing, deployment, and monitoring.
How to Build Data Pipelines for ML Projects with Python Code
Learn to build data pipelines for machine learning projects using Python. Explore ETL vs ELT, extraction, transformation, loading, and orchestration. Includes practical example of processing YouTube video transcripts.