Assuring Data Quality at Scale
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only! Grab it Explore the critical importance of data quality in AI-driven enterprises through this 50-minute Devoxx conference talk. Delve into the challenges of maintaining high-quality data in modern data ecosystems, examining both stream and batch processing perspectives. Learn about key dimensions and metrics of data quality, and discover an approach to implementing a scalable data quality platform. Gain insights into providing near real-time visibility of data quality issues, fitting this capability into existing data ecosystems, and triggering remediation actions. Understand the impact of data quality on ML model outputs, accuracy, relevance, and data engineering pipeline costs. Examine real-world examples of data quality issues and their consequences, and explore the concept of DataMesh for building decentralized data products.