[
https://issues.apache.org/jira/browse/SAMZA-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361672#comment-16361672
]
Shanthoosh Venkataraman commented on SAMZA-1585:
------------------------------------------------
[~boryas]
We'd discussed about this offline.
Proposal is to allow the additional stream processors to remain idle and not
kill them.
Idle stream processors will not participate in the group coordination
activities.
Leader will decide in JobModel generation phase whether to include the idle
stream processors(if any) to the group.
> Followers stopping themselves when their processorID doesn't exist in
> JobModel.
> -------------------------------------------------------------------------------
>
> Key: SAMZA-1585
> URL: https://issues.apache.org/jira/browse/SAMZA-1585
> Project: Samza
> Issue Type: Bug
> Reporter: Shanthoosh Venkataraman
> Assignee: Shanthoosh Venkataraman
> Priority: Major
>
> When a follower reads the propagated JobModel and finds out that it's
> processorID does not exist in the JobModel, the follower process will kill
> itself.
> If the follower joins the group when the leader is in the middle of
> generating the JobModel, the newly generated JobModel will not have the
> follower;s processorID(since the leader has not seen the change(follower
> joining the group)) and the follower will kill itself.
> This will trigger unexpected rebalance phases in the processors group and
> will overload some stream processors in the group.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
