[
https://issues.apache.org/jira/browse/IMPALA-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17026361#comment-17026361
]
Sahil Takiar commented on IMPALA-9342:
--------------------------------------
[~twmarshall] let me know if this makes sense. Will post a patch shortly.
> Membership updates should only remove a node from the blacklist if it is
> quiescing
> ----------------------------------------------------------------------------------
>
> Key: IMPALA-9342
> URL: https://issues.apache.org/jira/browse/IMPALA-9342
> Project: IMPALA
> Issue Type: Sub-task
> Components: Backend
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
>
> {{ClusterMembershipMgr::UpdateMembership}} will remove a node from the
> blacklist (if it is on the blacklist) if the method receives an update from
> the Statestore about the node. Currently, the Statestore *should* only send
> an update about the node if the node starts quiescing. If a node starts
> quiescing, it should be removed from the blacklist since it quiescing nodes
> aren't part of any executor groups anyway (no queries should be scheduled on
> them).
> After running some experiments locally, it seems there are some other cases
> where the Statestore sends the {{ClusterMembershipMgr}} an update about a
> node even if it's quiescing state has not changed. Unfortunately, I haven't
> been able to fully track down what is triggering this, so far it only happens
> on cluster start up.
> The {{ClusterMembershipMgr}} should only un-blacklist a node if that node is
> quiescing, currently it un-blacklists a node on any update to the node.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
