GitHub user wangyum opened a pull request:
https://github.com/apache/spark/pull/22879
[SPARK-25872][SQL][TEST] Add an optimizer tracker for TPC-DS queries
## What changes were proposed in this pull request?
Add an optimizer tracker for TPC-DS queries. For example:
1. Add `InferFiltersFromConstraints` and `PushDownPredicate` to
RewriteSubquery optimizer. All affected queries:
https://github.com/apache/spark/commit/5e124fa99962811b336cc4c5f2708fc61f72b8b2
2. Add `InferFiltersFromConstraints`, `PushDownPredicate` and
`CombineFilters` to RewriteSubquery optimizer. All affected queries:
https://github.com/apache/spark/commit/d3b11abc109374b469ad8878636ec622dd6e5634
## How was this patch tested?
manual tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/wangyum/spark SPARK-25872
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22879.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22879
----
commit f02baa71161d5c045d89b8338518decf0870c663
Author: Yuming Wang <yumwang@...>
Date: 2018-10-29T16:20:33Z
Add TPCDSQueryOptimizerTracker
commit 5e124fa99962811b336cc4c5f2708fc61f72b8b2
Author: Yuming Wang <yumwang@...>
Date: 2018-10-29T16:32:13Z
RewriteSubquery add InferFiltersFromConstraints and PushDownPredicate
commit d3b11abc109374b469ad8878636ec622dd6e5634
Author: Yuming Wang <yumwang@...>
Date: 2018-10-29T16:36:00Z
RewriteSubquery add CombineFilters
commit d8e8a9615144c620a62e326044e80fe1759d82e8
Author: Yuming Wang <yumwang@...>
Date: 2018-10-29T16:48:17Z
revert
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
