GitHub user liancheng opened a pull request:
https://github.com/apache/spark/pull/8799
[SPARK-10623] [SQL] Fixes ORC predicate push-down
When pushing down a leaf predicate, ORC `SearchArgument` builder requires
an extra "parent" predicate (any one among AND / OR / NOT) to wrap the leaf
predicate. E.g., to push down `a < 1`, we must build `AND(a < 1)` instead.
Fortunately, when actually constructing the `SearchArgument`, the builder will
eliminate all those unnecessary wrappers.
This PR is based on #8783 authored by @zhzhan. I also took the chance to
simply `OrcFilters` a little bit to improve readability.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/liancheng/spark spark-10623/fix-orc-ppd
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/8799.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #8799
----
commit 5febd8546ab4bcbb4ceb5e810b4547b857b39dd7
Author: Cheng Lian <[email protected]>
Date: 2015-09-17T16:19:45Z
Fixes ORC PPD
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
