[
https://issues.apache.org/jira/browse/IMPALA-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684200#comment-17684200
]
ASF subversion and git services commented on IMPALA-11891:
----------------------------------------------------------
Commit 253423f99c5b0dee14fa279f0a916f5ed1dc2f03 in impala's branch
refs/heads/master from zhangyifan27
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=253423f99 ]
IMPALA-11891: Remove empty executor groups
This patch removes executor groups from cluster membership after they
have no executors, so that executor groups' configurations can be
updated without restarting all impalads in the cluster.
Testing:
- Added an e2e test to verify the new functionality.
Change-Id: I480b84b26a780d345216004f1a4657c7b95dda45
Reviewed-on: http://gerrit.cloudera.org:8080/19468
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Wenzhe Zhou <[email protected]>
> Update executor group min size without restarting coordinators
> --------------------------------------------------------------
>
> Key: IMPALA-11891
> URL: https://issues.apache.org/jira/browse/IMPALA-11891
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 4.2.0
> Reporter: YifanZhang
> Assignee: YifanZhang
> Priority: Minor
>
> Currently, when updating an executor group's min size, we need to restart all
> executors in this executor group and all coordinators. Restarting
> coordinators will interrupt queries running on all executor groups.
> It is necessary to restart coordinators because executor groups will never be
> removed from a cluster during the lifetime of an impalad and inconsistent
> executor group configurations will be ignored when adding a new executor:
> [https://github.com/apache/impala/blob/c3ed44268838f4a00624e7e7fbf6e614f0a54a48/be/src/scheduling/executor-group.cc#L89-L93]
>
> We can improve this by removing empty/unused executor groups from the
> membership, and then new configurations of the same group names can be
> applied.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
