[
https://issues.apache.org/jira/browse/ARROW-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451370#comment-17451370
]
Weston Pace commented on ARROW-14890:
-------------------------------------
I've added the good-second-issue label as this would probably be a fairly
self-contained change (e.g. no need to make changes across the arrow code base
or multiple implementations) but don't mistake it for simple :). I'm guessing
there is a fair amount of complexity and some tricky test cases that will need
to be written.
> [C++][Dataset] Add support for filter pushdown in the ORC Scanner
> -----------------------------------------------------------------
>
> Key: ARROW-14890
> URL: https://issues.apache.org/jira/browse/ARROW-14890
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: C++
> Reporter: xiangxiang Shen
> Priority: Major
> Labels: dataset, good-second-issue, orc
>
> In arrow dataset, Filter pushdown can improve reading files performance
> greatly. We notice parquet has implemented,
> https://github.com/apache/arrow/blob/35b3567e73423420a99dbe6116f000e3c77d2a4c/cpp/src/arrow/dataset/file_parquet.cc#L465-L484.
> But ORC fileformat has not supported Filter pushdown. It ignores the "filter"
> of ScanOptions now.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)