Privacy and Security in Vehicular Data Aggregation Using Federated Learning - A Parking Occupancy Case Study
Explore privacy challenges in vehicular federated learning systems, focusing on data protection, route inference attacks, and security implications for intelligent city traffic prediction.
SQL 엔진을 더욱 강력하게 - 비정형 데이터 분석 정상에 서다
Discover how SK Hynix transforms unstructured semiconductor equipment data into structured formats using TrinoPy+, an enhanced SQL solution that enables seamless data preprocessing, analysis, and loading with single SQL queries.
지하철 혼잡도: 실시간 데이터 수집부터 분석까지
실시간 지하철 혼잡도 서비스의 데이터 수집, 분석, 처리 과정을 탐구하며 실시간 데이터 처리 시스템의 구조와 구현 방법을 심층적으로 이해합니다.
Techniques for Data Minimization in AI: Understanding Implementation and Trade-offs
Discover practical approaches to data minimization in AI development, from regulatory requirements to implementation strategies and understanding potential trade-offs in utility and compliance.
Data Lake Architecture - Preventing Data Swamps Through Proper Design
Discover essential strategies for architecting data lakes, preventing data swamps, and implementing effective governance frameworks for optimal big data analytics and storage solutions.
High Throughput Data Processing with GenStage
Explore Elixir's building blocks for efficient data ingestion, covering backpressure, partitioning, retries, and batching techniques for large-scale processing.
Enriching the Data vs Filtering in Apache Spark
Explore data enrichment vs filtering in Spark for improved performance and scalability in cloud-native applications, with practical examples and insights from Capital One's loyalty use case.
Building Apache NiFi 2.0 Python Processors - Conf42 Python 2024
Explore Apache NiFi 2.0 Python processors for data engineering, covering features, use cases, and real-time generative AI integration with a live demo.
Building a Modern Enterprise Data Ecosystem on Cloud - Conf42 Cloud Native 2024
Explore modern enterprise data ecosystems on cloud platforms, covering storage, organization, consumption, pipelines, and machine learning. Learn key components and AWS challenges.
Forecasting Time-Series with Polars and Deno
Explore time-series forecasting using Polars and Deno. Learn scaling techniques, pipeline optimization, and WASM integration for efficient data processing and prediction.
Affordable ML Platform: Key Components and Technical Points
Explore affordable ML platform design, components, and technical considerations for efficient and cost-effective machine learning implementation.
Enriching Generative AI Events in Real-Time Streaming Pipelines
Explore real-time streaming pipelines for enriching generative AI events, covering unstructured data handling, Milvus architecture, and NiFi 2.0 features with practical demos.
gRPC and AI: Adapting to Changing Development and Workload Paradigms
Explore AI's impact on development, workloads, and hardware, focusing on gRPC's role in AI and its adaptation to intense model training demands.
Forecasting Time Series with Arrow and WASM
Explore novel time-series processing pipeline using Apache Arrow, S3, Polars/DuckDB, and WASM for efficient forecasting and MLOps deployment.
Machine Learning for E-commerce Product Discovery - Finding a Needle in a Haystack
Explore machine learning techniques for efficient e-commerce product discovery, addressing challenges and leveraging NLP, image recognition, and knowledge graphs.
The Rise of the YAML Engineer - Declarative Paradigms in Data Systems
Explore the declarative paradigm in data frameworks, its impact on data practitioners, and the role of YAML. Dive into state management, GitOps, and the future of data engineering.
Data Pipelines with Celery: Modular, Signal-Driven and Manageable
Explore efficient data pipeline design using Celery, Redis, and signal-based triggering. Learn to segment workflows, manage API limits, and optimize data processing for improved throughput and maintainability.
Bytedance Deep Learning: Batch Flow Integrated Training Practice
Explore ByteDance's batch-stream integrated AI training engine, supporting large-scale cloud-native models for various businesses. Learn about flexible scheduling, data orchestration, and performance optimization techniques.
Harnessing WebAssembly for Real-time Stateless Streaming Pipelines
Explore WebAssembly's potential in revolutionizing real-time stateless streaming pipelines for Kafka, focusing on low-latency, high-volume data management.
Govern Your Self-Service Integration Processes
Implement clear governance for self-service data integration across diverse environments. Control and audit data loading, processing, and uploading with WOODY.IO.
Changes to Azure Synapse Analytics and Their Impact on Data Architecture Designs
Explore Azure Synapse Analytics' evolution and its impact on data transformation, storage, and querying methods to evaluate its suitability for your data environment.