GitHub user jianqiao opened a pull request:

    https://github.com/apache/incubator-quickstep/pull/113

    Optimizer changes for the LIPFilter feature.

    There will be three PRs for adding the _LIPFilter_ feature: optimizer 
changes / execution generator changes / relational operator changes. This is 
the first PR that does optimizer changes.
    
    LIP (lookahead information passing) filter is an improved semi-join 
optimization technique that pushes "future selectivities" down a left-deep 
query plan tree. For linear / bush trees, we can also search for the left-deep 
pattern in the tree and apply the LIP filter optimization.
    
    With LIP, the overall SSB benchmark (scale factor 100) performance will be 
improved from ~19 seconds to ~12 seconds on the cloudlab machine. The TPC-H 
benchmark performance will also be improved greatly (e.g. `Q02 6.7s -> 0.7s, 
Q17 166s -> 1.7s, Q20 55s -> 1.7s`).
    
    Main changes in this PR:
    (1) Rewrote `StarSchemaHashJoinOrderOptimization`. This changed some of the 
TPC-H query plans. One or two SSB query plans were also slightly changed due to 
an adjustment in `StarSchemaSimpleCostModel`. Nevertheless we will achieve an 
overall performance of ~12 seconds for the SSB benchmark when the full feature 
is there.
    (2) Added a `LIPFilterConfiguration` data structure to store the LIP filter 
information during query optimization.
    (3) Implemented optimizer rule `AttachLIPFilters` to decide and attach LIP 
filters to the physical query plan.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/incubator-quickstep 
lip-refactor-optimizer

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-quickstep/pull/113.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #113
    
----
commit 8740f50a710d0390155dc3a9a68dbbc2abe2cb7f
Author: Jianqiao Zhu <jianq...@cs.wisc.edu>
Date:   2016-09-07T18:20:43Z

    Optimizer changes for the LIPFilter feature.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Reply via email to