[
https://issues.apache.org/jira/browse/ORC-323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16401814#comment-16401814
]
ASF GitHub Bot commented on ORC-323:
------------------------------------
GitHub user ashish-kumar-sharma opened a pull request:
https://github.com/apache/orc/pull/232
ORC-323: Predicate push down for nested fields
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Flipkart/orc ORC-323
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/orc/pull/232.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #232
----
commit 0567d0febaa916c532ad4f609df37e6fa26d0a56
Author: Aashish Kumar Sharma <aashish.s@...>
Date: 2018-03-16T12:23:36Z
ORC-323: fix for nested fields
----
> Predicate push down for nested fields
> -------------------------------------
>
> Key: ORC-323
> URL: https://issues.apache.org/jira/browse/ORC-323
> Project: ORC
> Issue Type: Improvement
> Reporter: Ashish Sharma
> Priority: Major
>
> ORC supports predicate pushdown (block skipping) for ORC hive tables only on
> top-level fields.
> struct<int1:int,string1:string>
> ORC should also support block skipping on nested fields (within structs).
> struct<int1:int,complex:struct<int2:int,String1:string>>
> Advantage of having predicate pushdown in nested filed will allow ORC to skip
> blocks while having comparison at nested fields level. Skipping block will
> result in reduction of physical memory and compute.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
