GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/19149
[SPARK-21652][SQL][FOLLOW-UP] Fix rule confliction between
InferFiltersFromConstraints and ConstantPropagation
## What changes were proposed in this pull request?
The two rules `InferFiltersFromConstraints ` and `PruneFilters ` conflict
each other. They should not be in the same batch. If we put them in the same
batch, it could exceed the max iteration limit (i.e., 100) so that the final
plan might not be optimized.
This PR is to split them to two batches.
## How was this patch tested?
The existing test cases.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark inferFilterRule
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19149.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19149
----
commit 8e0979e9c7a88fe5ec8c5e6a29509ce6d343f947
Author: gatorsmile <gatorsm...@gmail.com>
Date: 2017-09-06T17:47:51Z
split batch
commit 9c57c8b2620032d9fe94153c8ea89275af48f714
Author: gatorsmile <gatorsm...@gmail.com>
Date: 2017-09-06T17:48:55Z
Merge remote-tracking branch 'upstream/master' into inferFilterRule
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
