Telemetry Data Understanding and Optimization for Cost-Effective Observability with Mezmo
Discover how to effectively manage and optimize telemetry data pipelines for enhanced observability, cost control, and faster incident response in enterprise systems.
Understand and Optimize Logs, Metrics, Traces, and Events with the Mezmo Telemetry Pipeline
Master telemetry data optimization techniques for DevOps and SREs, covering data profiling, signal isolation, and dynamic pipelines to enhance observability platform performance and reduce costs.
Optimizing High Density Storage for AI and ML Applications
Discover how to optimize high-density storage systems for AI/ML workloads, focusing on data pipelines, GPU utilization, and efficient solid-state storage solutions for large-scale models.
Better Together - Unleashing the Synergy of Pandas, Polars, and Apache Arrow
Discover how to optimize data engineering workflows by combining Pandas and Polars with Apache Arrow, learning techniques to build faster, more efficient data pipelines for scalable solutions.
Data Sharding and the Art of Real-Time Analytics at Scale
Discover how to implement data sharding for sub-second real-time analytics queries at scale, focusing on Apache Druid implementation, operational challenges, and performance optimization techniques.
SQL 엔진을 더욱 강력하게 - 비정형 데이터 분석 정상에 서다
Discover how SK Hynix transforms unstructured semiconductor equipment data into structured formats using TrinoPy+, an enhanced SQL solution that enables seamless data preprocessing, analysis, and loading with single SQL queries.
지하철 혼잡도: 실시간 데이터 수집부터 분석까지
실시간 지하철 혼잡도 서비스의 데이터 수집, 분석, 처리 과정을 탐구하며 실시간 데이터 처리 시스템의 구조와 구현 방법을 심층적으로 이해합니다.
셀프서비스 Stream Designer로 시스템 강화하기
Discover how Stream Designer platform revolutionizes real-time data processing in semiconductor manufacturing, enabling efficient DevOps and simplified data manipulation through self-service capabilities.
Building Mobility Data Platform with EMR and Airflow
Discover how to build and optimize a mobility data platform using AWS EMR and Airflow, focusing on migration strategies, cost optimization, and infrastructure automation with Terraform.
Managed Airflow Service Vane Development Journey
Dive into the development journey of Vane, a managed Airflow SaaS platform, exploring its architecture, implementation challenges, and valuable insights gained from operating data platforms at scale.
Modern Industrial Data Platform - Technical Deep Dive
Dive into SKT's innovative approach to modern industrial data platforms, exploring on-demand data mesh architecture and active metadata management for enhanced data pipeline efficiency.
Spark를 활용한 반도체 비정형 데이터 처리 및 조회 서비스 혁신
Discover how to optimize semiconductor unstructured data processing using Spark architecture and Big Data technologies for enhanced analysis capabilities in high-tech manufacturing environments.
On-Premise Kubernetes and Airflow ETL Platform (Haflow) - Introduction and Implementation
Discover SK하이닉스의 클라우드 네이티브 ETL 플랫폼 Haflow의 구축 사례와 아키텍처를 통해 기존 ETL 솔루션의 한계 극복 방안과 리소스 최적화 전략을 파악하세요.
Robust CI Workflow with dbt for Data Warehouse Optimization
Master continuous integration workflows in dbt to enhance data warehouse quality, implement test-driven development, and streamline collaboration for more reliable data processes.
Smart Approach in Development and Deployment Process for ML Models
Discover efficient strategies for ML model development, focusing on smart data mart creation, preprocessing techniques, and streamlined deployment processes using Python/PySpark.
Making Data the Central Feature: From Task-Oriented to Data-Oriented Workflows
Explore the shift from task-oriented to data-oriented workflows in modern data engineering, focusing on tools and approaches that prioritize data assets over process management.
Dyalog and Apache Kafka Integration - True?
Explore Apache Kafka's potential with Dyalog APL, learning about distributed event streaming, real-time data pipelines, and practical implementation examples.
Enriching the Data vs Filtering in Apache Spark
Explore data enrichment vs filtering in Spark for improved performance and scalability in cloud-native applications, with practical examples and insights from Capital One's loyalty use case.
Designing Streaming Data Pipelines: Best Practices - Cloud Native 2024
Explore best practices for designing streaming data pipelines, covering key concepts, challenges, and considerations for scalability in cloud-native environments.
Empowering Fearless Data Engineering with Rust
Explore Rust's impact on data engineering, focusing on performance, safety, and real-time analytics applications. Learn advantages and future prospects of Rust in the field.
Building Modern Data Streaming Apps with Python
Explore modern data streaming app development using Python, focusing on key benefits and unique aspects of building efficient, scalable applications.