Data Contracts for Long-Term Schema Management in Apache Kafka
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only! Grab it Explore effective strategies for long-term schema management using data contracts in this 57-minute podcast episode featuring Abraham Leal, Customer Success Technical Architect at Confluent. Learn about the importance of well-defined guidelines and standards for data quality, enforcement, and transfer across organizations. Discover the benefits of associating Apache Kafka® data with data contracts (schemas) and how to leverage schema registry for easy evolution. Gain insights into using GitOps automation features for managing data pipelines, topic versioning, and data quality assurance. Understand why Protobuf and Avro formats are preferred over XML or JSON for schema evolution and cost savings. Delve into concepts such as schema references, compatibility types, topic versioning tradeoffs, and upcasters/downcasters. Get recommendations on tools for improving data discoverability and learn how to implement schema registry effectively from the start.