Jason Fehr has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/22118


Change subject: IMPALA-13536: Fix Workload Management Init with Catalog HA
......................................................................

IMPALA-13536: Fix Workload Management Init with Catalog HA

When running an Impala cluster with catalogd HA enabled, the standby
catalogd would go into a loop waiting for the first catalog update to
arrive repeatedly logging the same error and never joining the server
thread defined in catalogd-main.cc.

When the standby daemon became active, the first catalogd update was
finally received, and the workload management initialization process
ran a second time in the newly active daemon because this daemon
saw that it was active.

The catalogd workload management initialization code now waits until
the active catalogd has been determined. At that point, the standby
daemon skips workload management initialization while the
active daemon runs it after it receives the first catalog update.

Testing was accomplished by modifying the workload management
initialization custom cluster tests to assert that the init process
is not re-run when a catalogd switches from standby to active and
also to remove the assumption that the first catalogd was active. The
test_catalog_ha test was deleted since all its assertions are handled
by the setup_method of the new TestWorkloadManagementCatalogHA class.

Ozone tests with and without erasure coding were also ran and passed.

Change-Id: Id3797a0a9cf0b8ae844d9b7d46b607d93824f69a
---
M be/src/catalog/catalog-server.cc
M be/src/catalog/catalog-server.h
M be/src/catalog/workload-management-init.cc
M tests/common/impala_test_suite.py
M tests/custom_cluster/test_workload_mgmt_init.py
5 files changed, 101 insertions(+), 65 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/18/22118/1
--
To view, visit http://gerrit.cloudera.org:8080/22118
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Id3797a0a9cf0b8ae844d9b7d46b607d93824f69a
Gerrit-Change-Number: 22118
Gerrit-PatchSet: 1
Gerrit-Owner: Jason Fehr <[email protected]>

Reply via email to