Weston Pace created ARROW-16275:
-----------------------------------
Summary: [C++] Add support for pushdown projection of nested
references
Key: ARROW-16275
URL: https://issues.apache.org/jira/browse/ARROW-16275
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Weston Pace
Now that we support nested field references we should support pushdown
predicates based on nested field references. For example:
{noformat}
dataset.to_table(filter=ds.field('values', 'one') > 200)
{noformat}
{{file_parquet.cc}} tests which row groups to include when scanning a parquet
fragment using parquet statistics. At the moment it skips any non-leaf
columns. That will need to change.
Second, even if we were able to detect and produce a guarantee based on nested
references, it's not clear the simplification logic would be able to detect
this and appropriately simplify. So there may be changes needed there too.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)