Guozhang Wang created KAFKA-8179:
------------------------------------

             Summary: Incremental Rebalance Protocol for Kafka Consumer
                 Key: KAFKA-8179
                 URL: https://issues.apache.org/jira/browse/KAFKA-8179
             Project: Kafka
          Issue Type: Improvement
          Components: consumer
            Reporter: Guozhang Wang
            Assignee: Guozhang Wang


Recently Kafka community is promoting cooperative rebalancing to mitigate the 
pain points in the stop-the-world rebalancing protocol. This ticket is created 
to initiate that idea at the Kafka consumer client, which will be beneficial 
for heavy-stateful consumers such as Kafka Streams applications.

In short, the scope of this ticket includes reducing unnecessary rebalance 
latency due to heavy partition migration: i.e. partitions being revoked and 
re-assigned. This would make the built-in consumer assignors (range, 
round-robin etc) to be aware of previously assigned partitions and be sticky in 
best-effort.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to