Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/18160 )
Change subject: IMPALA-11076: Reuse FDs loaded by HdfsTable during IcebergTable load ...................................................................... IMPALA-11076: Reuse FDs loaded by HdfsTable during IcebergTable load Impala used the FileSystem.getFileStatus() on every Iceberg DataFile to create the FileDescriptors. This operation is redundant because there is an internal HdfsTable inside the IcebergTable which loads the FileDescriptors recursively as well earlier. This commit updates the loadAllPartition operation to reuse the HdfsTable's FileDescriptors. Testing: - Executed the Iceberg tests. Change-Id: Id49daec60237dd6c8cce92c00a09fd9a6e6479b4 Reviewed-on: http://gerrit.cloudera.org:8080/18160 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M fe/src/main/java/org/apache/impala/catalog/FeIcebergTable.java 1 file changed, 29 insertions(+), 10 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/18160 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Id49daec60237dd6c8cce92c00a09fd9a6e6479b4 Gerrit-Change-Number: 18160 Gerrit-PatchSet: 5 Gerrit-Owner: Tamas Mate <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tamas Mate <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
