Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#PySpark

Showing: 52 courses

PySpark with Python

0 rewiews
Learn PySpark for big data processing: DataFrame operations, handling missing values, filtering, aggregations, MLlib basics, and Databricks integration. Includes linear regression implementation.
Add to list
9 Lesons
2 hours 30 minutes
On-Demand
Free-Video
The AI University

Machine Learning Using Spark MLLib

0 rewiews
Learn to implement machine learning algorithms using Spark MLLib, covering linear regression techniques, data preprocessing, model building, and evaluation methods in a hands-on, practical approach.
Add to list
13 Lesons
2 hours 30 minutes
On-Demand
Free-Video
PyCon US

SQL está en todas partes: Explorando alternativas con Ibis

0 rewiews
Descubre Ibis: una biblioteca Python para consultas de datos eficientes en múltiples backends. Simplifica el trabajo con bases de datos SQL y ofrece una alternativa a las complejas consultas tradicionales.
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
The Machine Learning Engineer

MLOps MLFlow: Mlflow Projects with PySpark Docker Environment and MLflow

0 rewiews
Aprende a utilizar MLflow Projects con entornos Pyspark y Docker para gestionar flujos de trabajo de aprendizaje automático de manera eficiente y reproducible.
Add to list
1 Lesons
28 minutes
On-Demand
Free-Video
Open Data Science

State of the Art Natural Language Understanding at Scale - David Talby

0 rewiews
Explore state-of-the-art NLP techniques using Apache Spark, covering core algorithms, distributed pipelines, and performance optimizations for large-scale language understanding applications.
Add to list
23 Lesons
50 minutes
On-Demand
Free-Video
Databricks

Accelerating MLOps with Apache Spark and SingleStore

0 rewiews
Learn to accelerate MLOps using Apache Spark and SingleStore. Discover how to build fast analytical applications, manage supervised learning models, and scale AI/ML operations for data science success.
Add to list
10 Lesons
25 minutes
On-Demand
Free-Video
Databricks

Project Zen - Improving Apache Spark for Python Users

0 rewiews
Discover improvements in Apache Spark for Python users, including redesigned documentation, type hints, PyPI distribution options, and enhanced PySpark features for a more Pythonic experience.
Add to list
19 Lesons
21 minutes
On-Demand
Free-Video
Databricks

Deep Dive into New Features of Apache Spark 3.1

0 rewiews
Explore Apache Spark 3.1's new features: ANSI SQL compliance, streaming enhancements, Python improvements, and performance optimizations for faster, easier, and smarter data processing.
Add to list
30 Lesons
49 minutes
On-Demand
Free-Video
Databricks

Comprehensive View on Intervals in Apache Spark 3.2

0 rewiews
Explore Apache Spark 3.2's interval enhancements, including ANSI SQL conformance, new interval types, and improved APIs. Learn to construct, use, and manage intervals effectively in Spark SQL and PySpark.
Add to list
14 Lesons
25 minutes
On-Demand
Free-Video
Bryan Cafferky

Master Databricks and Apache Spark Step by Step - PySpark Using RDDs

0 rewiews
Explore PySpark and RDDs in Databricks: Learn about lazy evaluation, transformations, and actions while analyzing data using Resilient Distributed Datasets.
Add to list
14 Lesons
21 minutes
On-Demand
Free-Video
Databricks

Data Science Across Data Sources with Apache Arrow - Accelerating Analytics and Interoperability

0 rewiews
Explore Apache Arrow's columnar in-memory data representation for real-time analytics across distributed systems. Learn how it accelerates data processing and enables interoperability between various analytical tools and data sources.
Add to list
16 Lesons
37 minutes
On-Demand
Free-Video
Databricks

PySpark in Apache Spark 3.3 and Beyond

0 rewiews
Explore PySpark's evolution in Apache Spark 3.3, including improved Pandas API, enhanced productivity features, and future developments. Learn about new functionalities, usability improvements, and performance enhancements.
Add to list
13 Lesons
35 minutes
On-Demand
Free-Video
Linux Foundation

Simplifying Testing of Spark Applications

0 rewiews
Learn techniques to simplify testing Spark applications, covering Python UDFs, Pandas UDFs, and functional APIs. Explore practical scenarios and demos for efficient data processing and analysis.
Add to list
21 Lesons
46 minutes
On-Demand
Free-Video
Ubuntu OnAir

Let's Play with Charmed Spark - Apache Spark on Kubernetes

0 rewiews
Explore Apache Spark on Kubernetes using Charmed Spark. Learn to deploy, configure, and run Spark workloads, integrate with Kafka, and monitor jobs through hands-on demonstrations.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
NashKnolX

Data Engineering with Databricks - Leveraging the Lakehouse Platform for ETL Pipelines

0 rewiews
Leverage Databricks Lakehouse Platform to build ETL pipelines, use Delta Live Tables, and orchestrate tasks with Workflows for efficient data processing.
Add to list
1 Lesons
44 minutes
On-Demand
Free-Video
Big Data Demystified

AWS EMR Demystified - Part 4

0 rewiews
Master AWS EMR's core components, from networking and storage to running PySpark jobs, while exploring integration with AWS Glue and Athena for effective big data processing and transformation.
Add to list
1 Lesons
45 minutes
On-Demand
Free-Video
Big Data Demystified

AWS EMR Demystified - Part 3

0 rewiews
Master AWS EMR's integration with Glue, Athena, and PySpark while learning essential data transformation techniques and architectural considerations for optimizing your data lake implementation.
Add to list
1 Lesons
1 hour 17 minutes
On-Demand
Free-Video
Big Data Demystified

AWS EMR, Hadoop, and Data Lake Architecture - Part 2

0 rewiews
Master AWS EMR's core components, including networking, storage types, and integration with AWS Glue and Athena. Learn to execute PySpark jobs and understand data transformation challenges in EMR-based data lakes.
Add to list
1 Lesons
2 hours 25 minutes
On-Demand
Free-Video
Open Data Science

PySpark Best Practices

0 rewiews
Learn best practices for PySpark, including dependency management, code structuring, testing, and performance optimization. Gain insights on writing efficient and scalable Python applications using Spark's distributed computing model.
Add to list
22 Lesons
46 minutes
On-Demand
Free-Video
Databricks

From Python to PySpark and Back Again - Unifying Single-Host and Distributed Deep Learning with Maggy

0 rewiews
Unifying single-host and distributed deep learning with Maggy framework, enabling seamless transition from laptop to cluster for efficient model development and training using TensorFlow and PySpark.
Add to list
8 Lesons
28 minutes
On-Demand
Free-Video
Databricks

Architecting for Data Quality in the Lakehouse with Delta Lake and PySpark

0 rewiews
Learn techniques for ensuring data quality in lakehouses using Delta Lake and PySpark. Explore data observability, reliability lifecycle, and practical implementation of quality checks across metadata, storage, and query layers.
Add to list
34 Lesons
1 hour 1 minute
On-Demand
Free-Video
Bryan Cafferky

Azure Databricks Using Python With PySpark

0 rewiews
Explore Python and PySpark in Azure Databricks: from basic concepts to advanced techniques, including DataFrame API, ML scaling, and data visualization.
Add to list
30 Lesons
52 minutes
On-Demand
Free-Video
Databricks

Rapid PySpark Custom Processing on Time Series Big Data in Databricks

0 rewiews
Efficient PySpark processing for time series big data, enabling rapid custom calculations on rolling windows with constant time complexity, demonstrated using Sleep Number Smartbed sensor data.
Add to list
1 Lesons
28 minutes
On-Demand
Free-Video
Databricks

Best Practices for Unit Testing PySpark

0 rewiews
Learn effective techniques for unit testing PySpark code, including local and CI testing, code structuring for testability, and integration testing with clusters for enhanced reliability and easier refactoring.
Add to list
1 Lesons
19 minutes
On-Demand
Free-Video
Databricks

Exploring UDTFs and Polymorphism in PySpark

0 rewiews
Learn to create and enhance User-Defined Table Functions in PySpark, including polymorphic UDTFs for flexible data processing. Gain practical insights through examples and expert guidance.
Add to list
1 Lesons
20 minutes
On-Demand
Free-Video
Databricks

Spark NLP - State-of-the-Art Natural Language Processing at Scale

0 rewiews
Discover scalable NLP techniques using Apache Spark, covering core algorithms, BERT embeddings, and multi-lingual challenges. Learn to build efficient pipelines for various NLP tasks through practical demonstrations.
Add to list
5 Lesons
30 minutes
On-Demand
Free-Video
Databricks

Deep Learning for Price Action Prediction Using Databricks and AWS

0 rewiews
Explore deep learning techniques to enhance price action prediction using Databricks and AWS. Learn to optimize technical indicators and train models with Amazon SageMaker for improved financial forecasting.
Add to list
14 Lesons
36 minutes
On-Demand
Free-Video
The Machine Learning Engineer

MLOps MLFlow: MLflow Projects with PySpark Docker Environments

0 rewiews
Explore MLflow Projects with PySpark in Docker, utilizing Databricks for artifact storage and tracking in MLOps workflows.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
PyCon US

Charlas - Marco Carranza: Estrategias para trabajar con datos a medida que estos crecen

0 rewiews
Estrategias para procesar datos crecientes con recursos limitados, desde una sola máquina hasta clusters, utilizando Pandas, Pyspark, Vaex y Modin. Enfoque práctico para investigadores y startups.
Add to list
6 Lesons
31 minutes
On-Demand
Free-Video
EuroPython Conference

PySpark and Warcraft Data

0 rewiews
Explore PySpark's capabilities for analyzing World of Warcraft auction data, comparing performance with other tools and demonstrating its application in processing large datasets efficiently.
Add to list
10 Lesons
38 minutes
On-Demand
Free-Video
EuroPython Conference

PySpark - Data Processing in Python on Top of Apache Spark

0 rewiews
Learn PySpark for large-scale data processing with Python on Apache Spark. Covers RDDs, DataFrame API, transformations, actions, and data sources. Ideal for those seeking efficient big data analysis techniques.
Add to list
14 Lesons
24 minutes
On-Demand
Free-Video
EuroPython Conference

Mastering a Data Pipeline with Python - 6 Years of Learned Lessons from Mistakes

0 rewiews
Explore key insights and best practices for building robust data pipelines with Python, covering data acquisition, transformation, storage, and workflow management based on 6 years of experience.
Add to list
1 Lesons
45 minutes
On-Demand
Free-Video
EuroPython Conference

Developing a Match-Making Algorithm Between Customers and Go-Jek Products

0 rewiews
Explore how GoJek developed a personalized recommendation system using PySpark to match customers with relevant products and vouchers, improving conversion rates.
Add to list
9 Lesons
29 minutes
On-Demand
Free-Video
EuroPython Conference

Building Reproducible Distributed Applications at Scale

0 rewiews
Explore challenges and solutions for packaging Python code in distributed computing environments, focusing on shipping methods, pickling, self-contained executables, and real-world examples with PySpark and S3 storage.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
EuroPython Conference

From Telemetry Data to CSVs with Python, Spark and Azure Databricks

0 rewiews
Transforming industrial telemetry data into CSV format using Python, Spark, and Azure Databricks for analytics and AI model retraining in the context of Industry 4.0.
Add to list
22 Lesons
24 minutes
On-Demand
Free-Video
EuroPython Conference

Data Warehouses Meet Data Lakes

0 rewiews
Explore modern data architecture using PySpark, Hudi, Delta.io, and Iceberg to address datalake challenges, supporting real-time processing and enterprise-wide digital transformation.
Add to list
1 Lesons
34 minutes
On-Demand
Free-Video
SF Python

Processing and Storing Time Series Instrument Data with Pandas and PySpark

0 rewiews
Master data processing techniques for handling large-scale time series instrument data using pandas and PySpark, focusing on efficient solutions for scientific and laboratory information management challenges.
Add to list
1 Lesons
29 minutes
On-Demand
Free-Video
Data Science Conference

Smart Approach in Development and Deployment Process for ML Models

0 rewiews
Discover efficient strategies for ML model development, focusing on smart data mart creation, preprocessing techniques, and streamlined deployment processes using Python/PySpark.
Add to list
1 Lesons
24 minutes
On-Demand
Free-Video
SQLBits

Web Scraping Puppy Data with Microsoft Fabric - 1st Leg

0 rewiews
Explore CSS Selectors for web scraping in Power Query, m code, and PySpark Notebooks within Microsoft Fabric's Azure cloud environment.
Add to list
1 Lesons
22 minutes
On-Demand
Free-Video
SQLBits

Data Linkage Options: MDM vs Splink in PySpark

0 rewiews
Explore data linkage solutions, comparing MDM and Splink (PySpark) for effective data integration and management.
Add to list
1 Lesons
21 minutes
On-Demand
Free-Video
SQLBits

Web Scraping Puppy Data with Microsoft Fabric - 2nd Leg

0 rewiews
Learn web scraping techniques using CSS Selectors in Power Query, m code, and PySpark within Microsoft Fabric to extract puppy data from websites.
Add to list
1 Lesons
22 minutes
On-Demand
Free-Video
SQLBits

Web Scraping Puppy Data with Microsoft Fabric - 2nd Leg

0 rewiews
Learn web scraping techniques using CSS Selectors in Power Query, m code, and PySpark within Microsoft Fabric to extract puppy data from websites.
Add to list
1 Lesons
22 minutes
On-Demand
Free-Video
SQLBits

Web Scraping Puppy Data with Microsoft Fabric - 1st Leg

0 rewiews
Explore CSS Selectors for web scraping in Power Query, m code, and PySpark Notebooks within Microsoft Fabric's Azure cloud environment.
Add to list
1 Lesons
22 minutes
On-Demand
Free-Video
CodeWithYu

Creating and Submitting PySpark Jobs to Spark Clusters

0 rewiews
Create and submit PySpark jobs to Spark clusters in an end-to-end data engineering project using Airflow, Docker, and multiple programming languages. Learn job creation, cluster submission, and result visualization.
Add to list
8 Lesons
17 minutes
On-Demand
Free-Video
CodeWithYu

End-to-End Data Engineering on Azure Spark Cluster: Japan Visa Analysis

0 rewiews
Set up Spark master-worker architecture in Docker on Azure, process and visualize Japan visa data using PySpark and Plotly. Clean, transform, and gain insights into visa trends through interactive data analysis.
Add to list
5 Lesons
59 minutes
On-Demand
Free-Video
Discover AI

The Intelligent Future of Data Warehouses and Delta Lake - Structured Streaming with PySPARK

0 rewiews
Explore the evolution of data warehousing from traditional ETL to modern Lakehouse architecture, focusing on Delta Lake, Structured Streaming, and PySpark implementation with practical code examples.
Add to list
1 Lesons
32 minutes
On-Demand
Free-Video
Data Science Festival

Spark at Scale: Engineering Strategies for Data Science Workflows

0 rewiews
Optimize PySpark applications and slash runtimes using engineering strategies for data science workflows, illustrated through a case study on in-store availability reporting.
Add to list
1 Lesons
40 minutes
On-Demand
Free-Video
NashKnolX

Introduction to PySpark

0 rewiews
Learn the fundamentals of PySpark for efficient big data processing and analytics using Python in Apache Spark's distributed computing environment.
Add to list
1 Lesons
43 minutes
On-Demand
Free-Video
Databricks

New Features of Apache Spark 3.5 - In-Depth Analysis

0 rewiews
Explore Apache Spark 3.5's advancements: Spark Connect, DeepSpeed integration, performance optimizations, new PySpark and SQL features for enhanced big data processing and AI capabilities.
Add to list
1 Lesons
33 minutes
On-Demand
Free-Video
Databricks

What's Next for the Upcoming Apache Spark 4.0

0 rewiews
Explore key enhancements in Apache Spark 4.0: Spark Connect, Structured Logging, PySpark updates, expanded SQL capabilities, improved connectivity, and real-time data processing advancements for optimized analytics.
Add to list
1 Lesons
38 minutes
On-Demand
Free-Video
Data Science Conference

Transaction Log as the Heart of Delta Lake - Understanding Structure and Operations

0 rewiews
Dive into the mechanics of Delta Lake's transaction log through hands-on PySpark exercises, exploring its structure, operations, and advantages over traditional data lakes.
Add to list
1 Lesons
1 hour 21 minutes
On-Demand
Free-Video
CodeWithYu

Apache Airflow with Spark for Data Engineers - Full Course

0 rewiews
Build end-to-end data engineering projects using Apache Airflow, Docker, Spark, and multiple programming languages. Learn to create and submit jobs to Spark clusters for processing and view real-time results.
Add to list
8 Lesons
1 hour 9 minutes
On-Demand
Free-Video