Sketched Sum-Product Networks for Joins
By: Brian Tsan , Abylay Amanbayev , Asoke Datta and more
Potential Business Impact:
Makes computer searches faster by guessing results.
Sketches have shown high accuracy in multi-way join cardinality estimation, a critical problem in cost-based query optimization. Accurately estimating the cardinality of a join operation -- analogous to its computational cost -- allows the optimization of query execution costs in relational database systems. However, although sketches have shown high efficacy in query optimization, they are typically constructed specifically for predefined selections in queries that are assumed to be given a priori, hindering their applicability to new queries. As a more general solution, we propose for Sum-Product Networks to dynamically approximate sketches on-the-fly. Sum-Product Networks can decompose and model multivariate distributions, such as relations, as linear combinations of multiple univariate distributions. By representing these univariate distributions as sketches, Sum-Product Networks can combine them element-wise to efficiently approximate the sketch of any query selection. These approximate sketches can then be applied to join cardinality estimation. In particular, we implement the Fast-AGMS and Bound Sketch methods, which have successfully been used in prior work, despite their costly construction. By accurately approximating them instead, our work provides a practical alternative to apply these sketches to query optimization.
Similar Papers
Join Cardinality Estimation with OmniSketches
Databases
Speeds up database queries by better row matching
A Unified Model for Cardinality Estimation by Learning from Data and Queries via Sum-Product Networks
Databases
Makes computer databases find information faster.
Sketch Disaggregation Across Time and Space
Networking and Internet Architecture
Splits data summaries across many network devices.