Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/16436 )
Change subject: IMPALA-10113: Add feature flag for incremental metadata updates ...................................................................... IMPALA-10113: Add feature flag for incremental metadata updates This patch adds a feature flag, enable_incremental_metadata_updates, to turn off incremental metadata (i.e. partition level metadata) propagation from catalogd to coordinators. It defaults to true. When setting to false, catalogd will send metadata updates in table granularity (the legacy behavior). Also fixes a bug of logging an empty aggregated partition update log when no partitions are changed in a DDL. Tests: - Run CORE tests with this flag set to true and false. - Add tests with enable_incremental_metadata_updates=false. Change-Id: I98676fc8ca886f3d9f550f9b96fa6d6bff178ebb Reviewed-on: http://gerrit.cloudera.org:8080/16436 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M be/src/common/global-flags.cc M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/catalog/ImpaladCatalog.java M fe/src/main/java/org/apache/impala/catalog/PartitionMetaSummary.java M fe/src/main/java/org/apache/impala/service/BackendConfig.java M tests/custom_cluster/test_disable_features.py M tests/custom_cluster/test_local_catalog.py 10 files changed, 63 insertions(+), 12 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/16436 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I98676fc8ca886f3d9f550f9b96fa6d6bff178ebb Gerrit-Change-Number: 16436 Gerrit-PatchSet: 7 Gerrit-Owner: Quanlong Huang <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]> Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]>
