Hello Gabor Kaszab, Zoltan Borok-Nagy, [email protected], Gergely Fürnstáhl,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/20010
to look at the new patch set (#2).
Change subject: [WIP] IMPALA-11996: Scanner change for Iceberg metadtata
querying
......................................................................
[WIP] IMPALA-11996: Scanner change for Iceberg metadtata querying
This commit adds a scan node for querying Iceberg metadata tables. The
method resembles to HBase table scans, the scan is executed with the
help of the Iceberg API and through JNI.
There is only one fragment created to query the Iceberg Metadata table
which is supposed to be executed on the coordinator node that already
has the metadata ready.
This change will not cover struct column types, it will be done in
IMPALA-12205.
TBD:
- further type supports
- extensive testing
Change-Id: I0e943cecd77f5ef7af7cd07e2b596f2c5b4331e7
---
M be/CMakeLists.txt
M be/src/exec/CMakeLists.txt
M be/src/exec/exec-node.cc
A be/src/exec/iceberg-metadata/CMakeLists.txt
A be/src/exec/iceberg-metadata/iceberg-metadata-scan-node.cc
A be/src/exec/iceberg-metadata/iceberg-metadata-scan-node.h
A be/src/exec/iceberg-metadata/iceberg-metadata-table-scanner.cc
A be/src/exec/iceberg-metadata/iceberg-metadata-table-scanner.h
M be/src/scheduling/scheduler.cc
M be/src/service/frontend.cc
M be/src/service/frontend.h
M be/src/util/jni-util.cc
M be/src/util/jni-util.h
M common/thrift/PlanNodes.thrift
M fe/src/main/java/org/apache/impala/analysis/IcebergMetadataTableRef.java
M fe/src/main/java/org/apache/impala/catalog/iceberg/IcebergMetadataTable.java
M fe/src/main/java/org/apache/impala/planner/DistributedPlanner.java
M fe/src/main/java/org/apache/impala/planner/IcebergMetadataScanNode.java
M fe/src/main/java/org/apache/impala/planner/IcebergScanPlanner.java
M fe/src/main/java/org/apache/impala/planner/SingleNodePlanner.java
M fe/src/main/java/org/apache/impala/service/Frontend.java
M fe/src/main/java/org/apache/impala/service/JniFrontend.java
M
testdata/workloads/functional-query/queries/QueryTest/iceberg-metadata-tables.test
23 files changed, 800 insertions(+), 164 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/10/20010/2
--
To view, visit http://gerrit.cloudera.org:8080/20010
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I0e943cecd77f5ef7af7cd07e2b596f2c5b4331e7
Gerrit-Change-Number: 20010
Gerrit-PatchSet: 2
Gerrit-Owner: Tamas Mate <[email protected]>
Gerrit-Reviewer: Anonymous Coward <[email protected]>
Gerrit-Reviewer: Gabor Kaszab <[email protected]>
Gerrit-Reviewer: Gergely Fürnstáhl <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
