[
https://issues.apache.org/jira/browse/KAFKA-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wouter Bancken updated KAFKA-6557:
----------------------------------
Description:
Using the kafka-consumer-groups tool to fetch the consumer offsets, the offsets
seem to be unavailable during rebalancing. During the rebalancing, the consumer
group has no partition assignments.
*Scenario sketch*
# I have a consumer group 'X' subscribed to topics 'A' and 'B' with partition
assignments and lag information. Consumer group 'X' is "Stable".
# a. Topic 'C' is (being) created.
b. During this creation, I do not have a partition assignment for consumer
group 'X' for topics 'A' and 'B' but the consumer group is still "Stable".
# A second later: I have a partition assignment for consumer group 'X' for
topics 'A' and 'B' again and the consumer group is still "Stable".
I at least expected the state of consumer group 'X' during step 2b to be
"PreparingRebalance" or "AwaitingSync". Otherwise there is no way to detect
that the consumer is rebalancing.
See the [discussion on the 'users'
mailinglist|https://mail-archives.apache.org/mod_mbox/kafka-users/201801.mbox/%3CCAL5nZgS1im_AVVCdknLjLCFK4CkCEaqH9%3DqctgZJZKB%3Dt3hxwg%40mail.gmail.com%3E]
for additional information.
was:
Using the kafka-consumer-groups tool to fetch the consumer offsets, the offsets
seem to be unavailable during rebalancing. During the rebalancing, the consumer
group has no partition assignments.
*Scenario sketch*
1. I have a consumer group 'X' subscribed to topics 'A' and 'B' with partition
assignments and lag information. Consumer group 'X' is "Stable".
2a. Topic 'C' is (being) created.2b. During this creation, I do not have a
partition assignment for consumer group 'X' for topics 'A' and 'B' but the
consumer group is still "Stable".
3. A second later: I have a partition assignment for consumer group 'X' for
topics 'A' and 'B' again and the consumer group is still "Stable".
I at least expected the state of consumer group 'X' during step 2b to be
"PreparingRebalance" or "AwaitingSync". Otherwise there is no way to detect
that the consumer is rebalancing.
See the [discussion on the 'users'
mailinglist|https://mail-archives.apache.org/mod_mbox/kafka-users/201801.mbox/%3CCAL5nZgS1im_AVVCdknLjLCFK4CkCEaqH9%3DqctgZJZKB%3Dt3hxwg%40mail.gmail.com%3E]
for additional information.
> Kafka Consumer Offsets are unavailable during rebalancing
> ---------------------------------------------------------
>
> Key: KAFKA-6557
> URL: https://issues.apache.org/jira/browse/KAFKA-6557
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 1.0.0
> Reporter: Wouter Bancken
> Priority: Major
>
> Using the kafka-consumer-groups tool to fetch the consumer offsets, the
> offsets seem to be unavailable during rebalancing. During the rebalancing,
> the consumer group has no partition assignments.
>
> *Scenario sketch*
> # I have a consumer group 'X' subscribed to topics 'A' and 'B' with
> partition assignments and lag information. Consumer group 'X' is "Stable".
> # a. Topic 'C' is (being) created.
> b. During this creation, I do not have a partition assignment for consumer
> group 'X' for topics 'A' and 'B' but the consumer group is still "Stable".
> # A second later: I have a partition assignment for consumer group 'X' for
> topics 'A' and 'B' again and the consumer group is still "Stable".
>
> I at least expected the state of consumer group 'X' during step 2b to be
> "PreparingRebalance" or "AwaitingSync". Otherwise there is no way to detect
> that the consumer is rebalancing.
> See the [discussion on the 'users'
> mailinglist|https://mail-archives.apache.org/mod_mbox/kafka-users/201801.mbox/%3CCAL5nZgS1im_AVVCdknLjLCFK4CkCEaqH9%3DqctgZJZKB%3Dt3hxwg%40mail.gmail.com%3E]
> for additional information.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
