Apache Spark Full Course - Learn Apache Spark 2020
In this 'Spark Tutorial' you will comprehensively learn all the major concepts of Spark such as Spark RDD, Dataframes, Spark SQL and Spark Streaming.
Spark Tutorials for Beginners
Learn Apache Spark fundamentals, including RDDs, SQL, streaming, and architecture. Hands-on tutorials cover setup, programming, and advanced concepts for big data processing.
Apache Spark Tutorials
Learn Apache Spark's distributed computing capabilities, architecture, and programming with Scala. Explore DataFrames, SQL, data sources, and advanced features like Delta Lake for efficient big data processing.
Understanding Spark SQL - Lesson 6
Explore Spark SQL's powerful features for data engineering, including query optimizations and support for Python, R, and Scala, enhancing parallel processing performance.
Accelerating Data Processing in Spark SQL with Pandas UDFs - Optimization Techniques
Learn to optimize Spark SQL data processing using Pandas UDFs. Discover techniques to speed up queries, profile jobs efficiently, and leverage custom UDFs for significant performance gains in large-scale data pipelines.
Bringing Satellite and Drone Imagery into Data Science Workflows
Explore satellite and drone imagery analysis in data science workflows using RasterFrames, a Spark SQL extension with Python API for processing spatial image data and integrating with ML frameworks.
Care and Feeding of Catalyst Optimizer - Practical Troubleshooting for Spark SQL
Explore Spark's Catalyst Optimizer challenges, including UDF issues, codegen limitations, and JVM tuning. Learn to diagnose and solve complex query problems for improved Spark SQL performance.
Faster, Safer, Serverless - Empowering Apache Spark Standalone Cluster on Kubernetes
Explore a K8s-native Serverless Spark Service that enhances speed and simplicity, featuring a new K8s operator for cluster creation and job submission, with rapid responsiveness and ML training integration.
Databricks Photon and Spark SQL in Advanced Database Systems - Lecture 20
Explore Databricks Photon and Spark SQL's advanced features for efficient data processing and analysis in modern database systems.
Databricks Photon and Spark SQL in Advanced Database Systems - Lecture 18
Explore Databricks Photon and Spark SQL architectures, optimizations, and performance improvements in modern data processing systems.
Data Engineering with Databricks - Leveraging the Lakehouse Platform for ETL Pipelines
Leverage Databricks Lakehouse Platform to build ETL pipelines, use Delta Live Tables, and orchestrate tasks with Workflows for efficient data processing.
Understanding the SQL Aspects of Spark - Spark SQL
Explore Spark SQL's capabilities for distributed processing of structured data, integrating relational operations with Spark's high-performance engine.
Introduction to Databricks and Data Lakehouse Architecture
Explore Data Lakehouse, Databricks platform, Spark architecture, and SQL. Learn advantages and common use cases of Databricks for data processing.
Optimizing Lakehouse Architecture Costs with Intel Software and Databricks
Enhance large-scale data processing for AI with autonomous CPU optimization, cost-effective resource management, improved scalability, and streamlined Spark operations using Intel's solutions for Databricks Data Intelligence Platform.
Azure Databricks with R - Deep Dive
Explore Azure Databricks using R for big data and machine learning. Learn Spark architecture, APIs, workspaces, and data manipulation techniques for efficient cloud-based analytics.