Wenzhe Zhou has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/20280 )
Change subject: IMPALA-12323: DDL hang with SYNC_DDL=1 when CatalogD HA enabled ...................................................................... IMPALA-12323: DDL hang with SYNC_DDL=1 when CatalogD HA enabled When CatalogD HA is enabled, standby catalogd does not receive catalog topic updates from statestore and does not apply catalog updates from the active catalogd. Its min topic version is not changed. Function Statestore::GetMinSubscriberTopicVersion() loops through all subscribers to find min topic version. Standby catalogd causes min topic version not increased, and hence Impala server waits indefinitely in ImpalaServer::WaitForCatalogUpdateTopicPropagation(). This patch fixed the issue by skipping standby catalogd when finding min topic version in Statestore::GetMinSubscriberTopicVersion(). Testing: - Added unit-test code for CatalogD HA to run DDL with SYNC_DDL as 1. Verified that test cases hang without fix, and test cases were passed after fix. - Passed test_catalogd_ha.py. Change-Id: Ie559c711078f32171dfb2d2e2fda54773c0927c3 --- M be/src/statestore/statestore.cc M tests/custom_cluster/test_catalogd_ha.py 2 files changed, 13 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/80/20280/2 -- To view, visit http://gerrit.cloudera.org:8080/20280 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ie559c711078f32171dfb2d2e2fda54773c0927c3 Gerrit-Change-Number: 20280 Gerrit-PatchSet: 2 Gerrit-Owner: Wenzhe Zhou <[email protected]> Gerrit-Reviewer: Abhishek Rawat <[email protected]> Gerrit-Reviewer: Andrew Sherman <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Wenzhe Zhou <[email protected]>
