Leveraging Open-Source Tools for Building a Quality Data Warehouse
Discover how to build a quality data warehouse using open-source tools. Learn about modern data stack architecture, test-driven approaches, and software development best practices for data transformation.
Building a Data Science Program in Higher Vocational Education
Explore a two-year data science program designed for higher vocational education, featuring industry-aligned courses and modern educational approaches like Discord communities and GitHub portfolios.
Pandas 2, Dask or Polars? Quickly Tackling Larger Data on a Single Machine
Explore Pandas 2, Dask, and Polars for efficient large data processing on a single machine. Compare features, performance, and ecosystem compatibility to choose the best tool for your research workflow.
Power Query in 20 Minutes - How it Works
Explore Power Query's internals and gain a deeper understanding of this increasingly prevalent tool in Power BI and Fabric technologies.
New Features of Apache NiFi - Tips and Techniques
Explore Apache NiFi's latest features, processors, and best practices. Build efficient data flows using cutting-edge techniques, with tips and guides for optimal implementation.
Declarative Reasoning with Timelines: The Next Step in Event Processing
Explore declarative reasoning with timelines for advanced event processing. Learn stream-native query abstractions and simplified time-based reasoning techniques for modern data processing challenges.
Batch and Stream Analysis with TypeScript Using Apache Beam
Explore batch and stream analysis using Beam's Typescript SDK. Learn API choices, usability, and functionality through demos. Discover how to leverage Typescript for efficient data processing workflows.
Apache Arrow and Go: A Match Made in Data
Explore Apache Arrow's Go implementation, covering Arrow and Parquet libraries, Flight server/client, C Data API integration, and performance optimization techniques.
Meta Velox - Advanced Database Systems - Lecture 23
Explore Meta's Velox query execution engine, its architecture, and its role in modern data processing systems. Learn about its features and performance optimizations.
Accelerating Apache Spark Workloads with Apache DataFusion Comet
Explore Apache DataFusion Comet's potential to enhance Apache Spark performance, optimizing data processing workflows and improving efficiency in large-scale analytics.
Apache Arrow DataFusion - A Fast, Embeddable, Modular Analytic Query Engine
Explore Apache Arrow DataFusion's fast, embeddable, and modular analytic query engine capabilities with insights from expert Andrew Lamb.
Challenges of Spark Application Coexisting with NoSQL Databases
Explore challenges and solutions for integrating Apache Spark with NoSQL databases like MongoDB and Cassandra in high-volume transaction processing systems, focusing on performance optimization and data modeling.
Machine Learning with Apache Beam
Explore Apache Beam for distributed data pipelines in machine learning, covering inference, data processing, and training with hands-on demos for parallelizing ML workloads.
Big Data Transformation Powered by Apache Spark
Revolutionize data processing with Spark. Master transformative functions, aggregation, array manipulation, and advanced joins to unlock actionable insights from big data.
Data Engineering: A Deep Dive into Databricks
Master Databricks for efficient data processing, focusing on Apache Spark transformations, ingestion methods, storage, orchestration, and best practices to optimize data engineering workflows.
Introduction to Azure Databricks
Explore Azure Databricks: Simplify big data analytics, streamline processing, and enhance data accessibility for informed decision-making.
Understanding the SQL Aspects of Spark - Spark SQL
Explore Spark SQL's capabilities for distributed processing of structured data, integrating relational operations with Spark's high-performance engine.
State Storage in Spark Structured Streaming
Learn to configure and manage state storage in Spark Structured Streaming for efficient data processing and analysis.
Introduction to Data Build Tool (DBT)
Master data build tool (DBT) for efficient data product development, including CICD, pipelines, validation, quality testing, deployment, and monitoring.
Classify Raster Operation in ProRaster Scientific - Deep Dive Tutorial
Explore ProRaster Scientific's Classify operation for raster data processing. Learn to classify continuous rasters, reclassify existing data, handle pyramid issues, and perform advanced classifications with practical examples.
How to Build Data Pipelines for ML Projects with Python Code
Learn to build data pipelines for machine learning projects using Python. Explore ETL vs ELT, extraction, transformation, loading, and orchestration. Includes practical example of processing YouTube video transcripts.