Demo - GitHub Data Crawling ETL Extract, Transfer, Load
7
Fetching Data with GitHub API
8
Repository & Gist Pydantic Model
9
Follower & User Pydantic Model
10
Object initialization, serializing, dumping
11
Load into SQLite
12
Learn more and connect
Description:
Explore the power of Pydantic for streamlining data preparation in this 25-minute guide from Python Data Science Day. Learn how to leverage Pydantic for data validation, type hinting, and structured data cleaning in Python projects. Discover core concepts, practical applications, and a hands-on demo of GitHub data crawling ETL. Follow along as the presenter demonstrates fetching data with the GitHub API, creating Pydantic models for repositories, gists, followers, and users, and implementing object initialization, serialization, and database loading. Gain valuable insights into ensuring data consistency, handling missing values, and optimizing your data science workflow with Pydantic.
Streamlining Data Preparation with Pydantic - A 25-Minute Guide