Efficient Query Processing for Unstructured Data Using Machine Learning

Efficient Query Processing for Unstructured Data Using Machine Learning

Explore efficient query processing techniques for unstructured data using machine learning in this 27-minute conference talk from Databricks. Learn about the TASTI system developed by Stanford DAWN lab to reduce query costs over unstructured data. Discover how proxy scores can accelerate aggregation, selection, and limit queries, and understand the process of generating these scores through principled clustering of unstructured data records. Gain insights into real-world applications, including ecological analysis and wildfire detection. Delve into the theoretical foundations of this work, based on four VLDB publications, and learn about the open-source code available for implementation.