Tamas Mate has uploaded a new patch set (#3). ( http://gerrit.cloudera.org:8080/18160 )
Change subject: IMPALA-11076: Reuse FDs loaded by HdfsTable during IcebergTable load ...................................................................... IMPALA-11076: Reuse FDs loaded by HdfsTable during IcebergTable load Impala used the FileSystem.getFileStatus() on every Iceberg DataFile to create the FileDescriptors. This operation is redundant because there is an internal HdfsTable inside the IcebergTable which loads the FileDescriptors recursively as well earlier. This commit updates the loadAllPartition operation to reuse the HdfsTable's FileDescriptors. Testing: - Executed the Iceberg tests. Change-Id: Id49daec60237dd6c8cce92c00a09fd9a6e6479b4 --- M fe/src/main/java/org/apache/impala/catalog/FeIcebergTable.java 1 file changed, 29 insertions(+), 10 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/60/18160/3 -- To view, visit http://gerrit.cloudera.org:8080/18160 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Id49daec60237dd6c8cce92c00a09fd9a6e6479b4 Gerrit-Change-Number: 18160 Gerrit-PatchSet: 3 Gerrit-Owner: Tamas Mate <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tamas Mate <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
