Heuristic and Cost-based Optimization for Diverse Provenance Tasks

Autor: Niu, Xing, Kapoor, Raghav, Glavic, Boris, Gawlick, Dieter, Liu, Zhen Hua, Krishnaswamy, Vasudha, Radhakrishnan, Venkatesh
Rok vydání: 2018
Předmět:
Zdroj: IEEE Transactions on Knowledge and Data Engineering (TKDE), 2018
Druh dokumentu: Working Paper
Popis: A well-established technique for capturing database provenance as annotations on data is to instrument queries to propagate such annotations. However, even sophisticated query optimizers often fail to produce efficient execution plans for instrumented queries. We develop provenance-aware optimization techniques to address this problem. Specifically, we study algebraic equivalences targeted at instrumented queries and alternative ways of instrumenting queries for provenance capture. Furthermore, we present an extensible heuristic and cost-based optimization framework utilizing these optimizations. Our experiments confirm that these optimizations are highly effective, improving performance by several orders of magnitude for diverse provenance tasks.
Comment: IEEE Transactions on Knowledge and Data Engineering (TKDE), 2018, long version, 31 pages. arXiv admin note: substantial text overlap with arXiv:1701.05513
Databáze: arXiv