Introduction to Apache Beam with Examples
Learn Apache Beam's unified model for batch and streaming data processing, with real-world examples from eBay and Mozilla's data pipelines.
Kafka Connectors: Introduction to Kafka Connect Framework
Explore Kafka Connect framework for integrating Kafka with external systems, focusing on cluster setup and connector functionality.
Navigating the Emerging LLMOps Stack
Explore the emerging LLMOps Stack, including tools and best practices for maximizing LLM potential in organizations. Gain insights from an experienced AI/ML engineering leader.
DataOps as a Service - Applying DevOps Practices to Data Engineering
Explore DevOps practices in data engineering, addressing challenges and showcasing the Versatile Data Kit for implementing DataOps principles.
Azure Data Factory: Cloud ETL Service for Data Integration and Transformation
Master Azure Data Factory for serverless data integration and transformation, with code-free UI and SSIS compatibility.
Scaling Data Reliably: A Journey in Growing Through Data Pain Points
Explore Data Reliability Engineering, borrowing from SRE. Learn to minimize downtime, leverage metadata, and identify system failures for robust data systems.
Charting the Lakehouse Trail: A Data Migration Adventure
Explore a data migration journey from legacy warehouse to modern lakehouse. Gain insights on overcoming challenges and achieving seamless transitions for your organization.
Introducing lolpop: An Open Source Framework for Machine Learning Workflows
Explore lolpop, an open-source framework bridging data science and ML engineering. Learn how it enhances collaboration, boosts productivity, and revolutionizes machine learning workflows across diverse scenarios.
Bridging the Gap Between Batch and Real-Time with Mixed-Latency Pipelines
Explore mixed-latency data platforms, manage data freshness, and tackle pipeline bottlenecks. Learn to merge batch and low-latency processing while maintaining explicit lineage for reliable data products.
The Road to Exceptional Data Correctness - Strategies from Stripe
Discover strategies for achieving exceptional data correctness in financial technology, including infrastructure design, quality checks, and observability platforms.
How to End the Long Tail of Most Data Requests
Discover how an ad-hoc layer empowers data analysts to swiftly answer questions, iterate with stakeholders, and deliver analyses, optimizing resource allocation for production processes.
What I Don't Want to Exist in the Data World in 5 Years
Explore outdated data tools and practices to eliminate, enhancing project efficiency and data engineering satisfaction. Gain insights on modernizing data infrastructure for improved outcomes.
Data Contracts in the Modern Data Stack
Explore data contracts using Protobuf for event definitions, governing production, and automating DBT models in Whatnot's modern data stack processing millions of events daily.
Integrating Data People in App Development Team Workflows - Hot Takes and Tragic Mistakes
Discover strategies for seamlessly integrating data professionals into app development workflows. Learn from common pitfalls and gain insights on effective collaboration between data scientists, engineers, and traditional dev teams.
Feed the Alligators With the Lights On - How Data Engineers Can See Who Really Uses Data
Explore data catalog creation, metadata utilization, and self-serve data culture. Learn to navigate large datasets, distinguish trustworthy data, and leverage query logs for effective data management.
Big Data is Dead - The End of an Era and the Future of Data Analytics
Explore why the Big Data era is ending and learn to focus on data utilization for better decision-making, drawing insights from industry analysis and expert experience.
How Bosch Power Tools Leverages User Data and AI for Consumer Feedback and ETL Pipeline Management
Discover how Bosch Power Tools harnesses AI and data analytics to process consumer feedback, maintain language consistency, and optimize ETL pipelines for enhanced customer satisfaction.
Secure AI Orchestration: Mitigating Model-centric Attacks with Flyte
Discover how to protect AI systems from model-centric attacks, focusing on code injection and LLM vulnerabilities, while implementing security measures using Flyte orchestration and open-source tools.
Solving Security's Data Problem - Building Sustainable Security Architecture
Discover how data pipelines can revolutionize security architecture by reducing volume, improving signal-to-noise ratios, and creating more efficient, cost-effective security operations.
Enabling Cloud Workloads with the WEKA Data Platform
Discover how the WEKA Data Platform transforms data silos into dynamic pipelines, optimizing GPU performance and streamlining AI, ML, and HPC workloads in modern cloud environments.
Empowering Cloud Data with CTERA Data Services - Creating Custom Data Pipeline Workflows
Discover how to leverage global file systems for seamless cloud data management, create custom data pipelines, and implement analytics workflows using CTERA's advanced data services platform.