[
https://issues.apache.org/jira/browse/ARROW-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weston Pace updated ARROW-16275:
--------------------------------
Summary: [C++] Add support for pushdown filtering of nested references
(was: [C++] Add support for pushdown projection of nested references)
> [C++] Add support for pushdown filtering of nested references
> -------------------------------------------------------------
>
> Key: ARROW-16275
> URL: https://issues.apache.org/jira/browse/ARROW-16275
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Weston Pace
> Priority: Major
>
> Now that we support nested field references we should support pushdown
> predicates based on nested field references. For example:
> {noformat}
> dataset.to_table(filter=ds.field('values', 'one') > 200)
> {noformat}
> {{file_parquet.cc}} tests which row groups to include when scanning a parquet
> fragment using parquet statistics. At the moment it skips any non-leaf
> columns. That will need to change.
> Second, even if we were able to detect and produce a guarantee based on
> nested references, it's not clear the simplification logic would be able to
> detect this and appropriately simplify. So there may be changes needed there
> too.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
