Yida Wu has uploaded this change for review. ( http://gerrit.cloudera.org:8080/23094
Change subject: IMPALA-12057: Track removed coordinators to reject queued queries early ...................................................................... IMPALA-12057: Track removed coordinators to reject queued queries early Queries in global admission control can remain queued for a long time if they are assigned to a coordinator that has already left the cluster. Admissiond can't distinguish between a coordinator that hasn’t yet been propagated via the statestore and one that has already been removed, resulting in unnecessary waiting until timeout. This change tracks recently removed coordinators and rejects such queued queries immediately using REASON_COORDINATOR_REMOVED. To ensure the removed coordinator list remains simple and bounded, it avoids duplicate entries and enforces FIFO eviction at MAX_REMOVED_COORD_SIZE (1000). Tests: Added unit tests to verify the eviction logic and the duplicate case. Manually verified that queries no longer cause infinite wait logs in admissiond when the assigned coordinator is gone while the query is still queued. Change-Id: I1e0f270299f8c20975d7895c17f4e2791c3360e0 --- M be/src/scheduling/admission-controller.cc M be/src/scheduling/cluster-membership-mgr-test.cc M be/src/scheduling/cluster-membership-mgr.cc M be/src/scheduling/cluster-membership-mgr.h 4 files changed, 155 insertions(+), 9 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/94/23094/1 -- To view, visit http://gerrit.cloudera.org:8080/23094 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I1e0f270299f8c20975d7895c17f4e2791c3360e0 Gerrit-Change-Number: 23094 Gerrit-PatchSet: 1 Gerrit-Owner: Yida Wu <[email protected]>
