Prateek Maheshwari created SAMZA-1643:

             Summary: StreamPartitionCountMonitor should only restart/shut down 
the job if partition count increases
                 Key: SAMZA-1643
             Project: Samza
          Issue Type: Bug
            Reporter: Prateek Maheshwari
            Assignee: Prateek Maheshwari

Make StreamPartitionCountMonitor less aggressive and only restart (stateless) 
or shut down (stateful) the job if partition count increases.

In some versions of KafkaConsumer, partitionFor(topic) can return a count lower 
than the configured number of partitions if the broker it asks has recently 

The only downside of not restarting the job on partition count decreases is 
that some containers may be idle.

This message was sent by Atlassian JIRA

Reply via email to