Quanlong Huang has uploaded this change for review. ( http://gerrit.cloudera.org:8080/16058
Change subject: IMPALA-7538: Support HDFS caching with LocalCatalog ...................................................................... IMPALA-7538: Support HDFS caching with LocalCatalog This patch adds support for HDFS caching in LocalCatalog coordinators. We use the same way catalogd propagates HdfsCachePools in catalog-v1. They are cached in LocalCatalog coordinators as v1 and are not “fetch-on-demand” since only cache pool names are cached. The isMarkedCached markers of HdfsTable and HdfsPartition are also propagated to the LocalCatalog coordinators for correctly handling ShowTableStats and ShowPartitions statements with caching information. Tests: - Revive hdfs caching related tests in metadata/test_ddl.py and query_test/test_hdfs_caching.py for LocalCatalog. Change-Id: I661f7b76a9575f6f5b3fa2c6feebda1a5d7c3712 --- M common/thrift/CatalogService.thrift M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java M fe/src/main/java/org/apache/impala/catalog/FeCatalog.java M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java M fe/src/main/java/org/apache/impala/catalog/local/DirectMetaProvider.java M fe/src/main/java/org/apache/impala/catalog/local/LocalCatalog.java M fe/src/main/java/org/apache/impala/catalog/local/LocalFsPartition.java M fe/src/main/java/org/apache/impala/catalog/local/LocalFsTable.java M fe/src/main/java/org/apache/impala/catalog/local/MetaProvider.java M tests/common/skip.py M tests/metadata/test_ddl.py M tests/query_test/test_hdfs_caching.py 13 files changed, 155 insertions(+), 33 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/58/16058/1 -- To view, visit http://gerrit.cloudera.org:8080/16058 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I661f7b76a9575f6f5b3fa2c6feebda1a5d7c3712 Gerrit-Change-Number: 16058 Gerrit-PatchSet: 1 Gerrit-Owner: Quanlong Huang <[email protected]>
