GitHub user ptkool opened a pull request:
https://github.com/apache/spark/pull/18424
[SPARK-21218] Add rule to convert IN predicate to equivalent Parquet filter.
## What changes were proposed in this pull request?
Add a new optimizer rule to convert an IN predicate to an equivalent
Parquet filter.
## How was this patch tested?
Tested using unit tests, integration tests, and manual tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ptkool/spark convert_in_predicate_for_parquet
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18424.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18424
----
commit e98fbd8ca3698434ab04cb9b24a5a44412a866fb
Author: ptkool <[email protected]>
Date: 2017-06-26T19:02:38Z
Add rule to convert IN predicate to equivalent Parquet filter.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
