Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/16058 )
Change subject: IMPALA-7538: Support HDFS caching with LocalCatalog ...................................................................... IMPALA-7538: Support HDFS caching with LocalCatalog This patch adds support for HDFS caching in LocalCatalog coordinators. We use the same way catalogd propagates HdfsCachePools in catalog-v1. They are cached in LocalCatalog coordinators as v1 and are not “fetch-on-demand” since only cache pool names are cached. The isMarkedCached markers of HdfsTable and HdfsPartition are also propagated to the LocalCatalog coordinators for correctly handling ShowTableStats and ShowPartitions statements with caching information. Tests: - Revive hdfs caching related tests in metadata/test_ddl.py and query_test/test_hdfs_caching.py for LocalCatalog. Change-Id: I661f7b76a9575f6f5b3fa2c6feebda1a5d7c3712 Reviewed-on: http://gerrit.cloudera.org:8080/16058 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M common/thrift/CatalogService.thrift M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java M fe/src/main/java/org/apache/impala/catalog/FeCatalog.java M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java M fe/src/main/java/org/apache/impala/catalog/local/DirectMetaProvider.java M fe/src/main/java/org/apache/impala/catalog/local/LocalCatalog.java M fe/src/main/java/org/apache/impala/catalog/local/LocalFsPartition.java M fe/src/main/java/org/apache/impala/catalog/local/LocalFsTable.java M fe/src/main/java/org/apache/impala/catalog/local/MetaProvider.java M tests/common/skip.py M tests/metadata/test_ddl.py M tests/query_test/test_hdfs_caching.py 13 files changed, 175 insertions(+), 34 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/16058 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I661f7b76a9575f6f5b3fa2c6feebda1a5d7c3712 Gerrit-Change-Number: 16058 Gerrit-PatchSet: 4 Gerrit-Owner: Quanlong Huang <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]> Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]>
