Tamas Mate has uploaded this change for review. ( http://gerrit.cloudera.org:8080/18531
Change subject: IMPALA-10453: Support file pruning via runtime filters on Iceberg ...................................................................... IMPALA-10453: Support file pruning via runtime filters on Iceberg Iceberg tables store partition information in manifest files and not in the file path. This metadata has already been pushed down to the scanners and this commit uses this metadata to evaluate runtime filters on Iceberg files. Testing: * Added e2e tests. Change-Id: I7762e1238bdf236b85d2728881a402a2bb41f36a --- M be/src/exec/file-metadata-utils.cc M be/src/exec/file-metadata-utils.h M be/src/exec/hdfs-scan-node-base.cc M be/src/exec/hdfs-scan-node-base.h M be/src/exec/hdfs-scanner.cc A testdata/workloads/functional-query/queries/QueryTest/iceberg-partition-runtime-filter.test M tests/query_test/test_runtime_filters.py 7 files changed, 134 insertions(+), 30 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/31/18531/1 -- To view, visit http://gerrit.cloudera.org:8080/18531 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I7762e1238bdf236b85d2728881a402a2bb41f36a Gerrit-Change-Number: 18531 Gerrit-PatchSet: 1 Gerrit-Owner: Tamas Mate <[email protected]>
