Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#Parquet

Showing: 19 courses
The ASF

Bytedance's Parquet Format Optimization for Cost Reduction and Efficiency

0 rewiews
Optimize Parquet file operations for big data efficiency. Learn binary copy techniques to enhance file overwriting, merge small files, and implement column-level TTL, boosting performance 10+ times.
Add to list
1 Lesons
23 minutes
On-Demand
Free-Video
Databricks

Degrading Performance - Understanding and Solving Small Files Syndrome

0 rewiews
Learn how small files impact data pipeline performance, understand cloud storage and Apache Spark interactions, and discover DeltaLake solutions for improved efficiency in handling massive datasets.
Add to list
9 Lesons
27 minutes
On-Demand
Free-Video
Databricks

Optimizing Spark SQL Jobs with Parallel and Asynchronous IO

0 rewiews
Optimizing Spark SQL jobs through parallel and async IO techniques, including file-level and row group-level parallel read, asynchronous spill, and parquet column family, resulting in 5-30% performance improvement.
Add to list
8 Lesons
21 minutes
On-Demand
Free-Video
Databricks

Recent Parquet Improvements in Apache Spark - Vectorized Complex Types and Column Index Support

0 rewiews
Explore recent improvements in Apache Spark's Parquet performance, including vectorized read support for complex types and column index support, leading to significant speed enhancements and efficient data processing.
Add to list
19 Lesons
37 minutes
On-Demand
Free-Video
Databricks

The Parquet Format and Performance Optimization Opportunities

0 rewiews
Explore Parquet format intricacies, columnar storage basics, and optimization techniques for Spark workloads. Learn about encoding, compression, predicate pushdown, and Delta Lake to enhance analytical performance.
Add to list
16 Lesons
41 minutes
On-Demand
Free-Video
Databricks

The Apache Spark File Format Ecosystem - Optimizing Storage for Performance

0 rewiews
Explore key file formats in Spark ecosystem: Parquet, ORC, Avro. Learn core concepts, optimization techniques, and how to select the right format for performant data processing and AI/ML workflows.
Add to list
22 Lesons
29 minutes
On-Demand
Free-Video
Databricks

Building a Streaming Microservice Architecture with Apache Spark Structured Streaming

0 rewiews
Explore building a scalable, fault-tolerant streaming microservice architecture using Apache Spark, Kafka, gRPC, and Delta Lake for real-time data processing and reliable insights.
Add to list
13 Lesons
39 minutes
On-Demand
Free-Video
The ASF

Caching Framework for Exabyte-Scale Data Lakes

0 rewiews
Optimize exabyte-scale data lakes with open-source caching framework. Improve performance, reduce costs, and tackle challenges in complex data environments using Hadoop, Parquet, Hudi, and Alluxio.
Add to list
1 Lesons
40 minutes
On-Demand
Free-Video
The ASF

Apache Arrow and Go: A Match Made in Data

0 rewiews
Explore Apache Arrow's Go implementation, covering Arrow and Parquet libraries, Flight server/client, C Data API integration, and performance optimization techniques.
Add to list
1 Lesons
42 minutes
On-Demand
Free-Video
OSACon

Introduction to DuckDB: An In-Process Analytical Database Management System

0 rewiews
Discover DuckDB's powerful analytical database system, featuring in-process execution, multi-language support, and efficient data processing capabilities for handling large datasets on a single laptop.
Add to list
6 Lesons
28 minutes
On-Demand
Free-Video
GOTO Conferences

DuckDB: Crunching Data Anywhere - From Laptops to Servers

0 rewiews
Discover how DuckDB enables efficient data analysis across devices, from processing hundreds of gigabytes on laptops to terabytes on servers, with native support for SQL and popular file formats.
Add to list
16 Lesons
37 minutes
On-Demand
Free-Video
Databricks

Sound Data Engineering in Rust - From Bits to DataFrames

0 rewiews
Explore Rust for efficient data engineering, from low-level bit manipulation to high-performance DataFrames using Apache Arrow. Learn optimization techniques and benchmarks for improved data processing.
Add to list
15 Lesons
35 minutes
On-Demand
Free-Video
Linux Foundation

OLAP on Cassandra Data with Arrow, Flight SQL, ADBC, and DuckDB

0 rewiews
Explore modern OLAP techniques for Cassandra data using Arrow, Flight SQL, ADBC, and DuckDB. Learn to convert sstable snapshots to Parquet, enable real-time analytics, and leverage Flight SQL for efficient querying.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
Keith Galli

Complete Python Pandas Data Science Tutorial - 2024 Updated Edition

0 rewiews
Comprehensive tutorial on Python Pandas for data analysis, covering basics to advanced techniques. Learn to manipulate, filter, and aggregate data efficiently using the latest Pandas features and AI tools.
Add to list
28 Lesons
1 hour 34 minutes
On-Demand
Free-Video
Data Council

The Future Roadmap for the Composable Data Stack

0 rewiews
Explore advancements in data processing with Wes McKinney. Learn about Parquet, Arrow, and interface libraries like Ibis and tidyverse. Gain insights into current project states and future innovations.
Add to list
1 Lesons
33 minutes
On-Demand
Free-Video
DSDSD - Dutch Seminar on Data Systems Design

Implementing InfluxDB IOx Using Apache Arrow, DataFusion, and Rust

0 rewiews
Discover how modern database systems are built using Apache Arrow, DataFusion, and Rust, exploring the architecture and implementation of InfluxDB IOx through deconstructed database approaches and open-source components.
Add to list
1 Lesons
49 minutes
On-Demand
Free-Video
Confluent

Maximizing Real-Time Data Processing with Apache Kafka and InfluxDB - A Comprehensive Guide

0 rewiews
Learn to create powerful data pipelines by combining Apache Kafka and InfluxDB for real-time processing, analysis, and visualization of large-scale data, especially in IoT applications.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
Databricks

How to Migrate from Snowflake to an Open Data Lakehouse Using Delta Lake UniForm

0 rewiews
Explore Delta Lake UniForm's ability to create a single data set accessible across multiple open table formats, enhancing data lakehouse architecture efficiency and flexibility.
Add to list
1 Lesons
36 minutes
On-Demand
Free-Video
John Savill's Technical Training

Microsoft Fabric Overview - Features, Benefits, and Use Cases

0 rewiews
Explore Microsoft Fabric's powerful features for organizational data management, including OneLake, lakehouses, warehouses, and AI integration. Learn key benefits and use cases for data engineering and analysis.
Add to list
31 Lesons
1 hour 39 minutes
On-Demand
Free-Video