Wouter Bancken created KAFKA-6557:

             Summary: Kafka Consumer Offsets are unavailable during rebalancing
                 Key: KAFKA-6557
                 URL: https://issues.apache.org/jira/browse/KAFKA-6557
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 1.0.0
            Reporter: Wouter Bancken

Using the kafka-consumer-groups tool to fetch the consumer offsets, the offsets 
seem to be unavailable during rebalancing. During the rebalancing, the consumer 
group has no partition assignments.

*Scenario sketch*
1. I have a consumer group 'X' subscribed to topics 'A' and 'B' with partition 
assignments and lag information. Consumer group 'X' is "Stable".
2a. Topic 'C' is (being) created.2b. During this creation, I do not have a 
partition assignment for consumer group 'X' for topics 'A' and 'B' but the 
consumer group is still "Stable".
3. A second later: I have a partition assignment for consumer group 'X' for 
topics 'A' and 'B' again and the consumer group is still "Stable".

I at least expected the state of consumer group 'X' during step 2b to be 
"PreparingRebalance" or "AwaitingSync". Otherwise there is no way to detect 
that the consumer is rebalancing.


See the [discussion on the 'users' 
 for additional information.

This message was sent by Atlassian JIRA

Reply via email to