[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895333#comment-15895333 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2636 > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > Fix For: 0.11.0.0 > > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895265#comment-15895265 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/2636 MINOR: Follow up to KAFKA-2857 You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka minor/kafka-2857-followup Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/2636.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2636 > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > Fix For: 0.11.0.0 > > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894950#comment-15894950 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2538 > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > Fix For: 0.11.0.0 > > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861796#comment-15861796 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/2538 KAFKA-2857: Retry querying the consumer group while initializing This applies to new-consumer based groups and would avoid scenarios in which user issues a `--describe` query while the group is initializing. Example: The following could occur for a newly created group. ``` kafka@kafka:~/workspace/kafka$ bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --describe --group g Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers). Error: Executing consumer group command failed due to The group coordinator is not available. ``` With this PR the group is queried repeatedly at specific intervals within a preset (and configurable) timeout `group-init-timeout` to circumvent unfortunate situations like above. You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka KAFKA-2857 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/2538.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2538 commit 1e801041793d47bff2f3a4414b4bb7c3dd27ad04 Author: Vahid HashemianDate: 2017-02-09T20:48:10Z KAFKA-2857: Retry querying the consumer group while the group initializes This applies to new-consumer based groups and would avoid scenarios in which user issues a `--describe` query while the group is stabilizing. Example: The following could occur for a newly created group. ``` kafka@kafka:~/workspace/kafka$ bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --describe --group g Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers). Error: Executing consumer group command failed due to The group coordinator is not available. ``` With this PR the group is queried repeatedly at specific intervals within a preset (and configurable) timeout `group-init-timeout` to circumvent unfortunate situations like above. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855052#comment-15855052 ] Vahid Hashemian commented on KAFKA-2857: Sorry, you are right. This would become a config option for the consumer group command (for new consumers only). > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855034#comment-15855034 ] Jason Gustafson commented on KAFKA-2857: Hmm, I thought we used the admin client for this API. Isn't that where the timeout should go? > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855001#comment-15855001 ] Vahid Hashemian commented on KAFKA-2857: [~hachikuji] Great. I assume you are suggesting adding a consumer config for this timeout. If so, do you think a KIP is required? > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854712#comment-15854712 ] Jason Gustafson commented on KAFKA-2857: [~vahid] Sounds reasonable. At least we should have a timeout which can be overridden though. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848972#comment-15848972 ] Vahid Hashemian commented on KAFKA-2857: [~hachikuji] I am thinking about the two options you suggested earlier ([here|https://issues.apache.org/jira/browse/KAFKA-2857?focusedCommentId=15326653=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15326653]) and am wondering if retrying in case of "coordinator not available" would provide a better user experience. IMHO, user's goal is to get the group details and they would probably rather not having to issue the command twice to get it. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Vahid Hashemian >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843579#comment-15843579 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/2203 > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714543#comment-15714543 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1548 > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373430#comment-15373430 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1548 > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373431#comment-15373431 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user imandhan reopened a pull request: https://github.com/apache/kafka/pull/1548 KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. You can merge this pull request into a Git repository by running: $ git pull https://github.com/imandhan/kafka KAFKA-2857 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1548.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1548 commit c27df5a17a6bbb34a6118bb7b74d6f3e80239612 Author: Ishita MandhanDate: 2016-06-23T23:46:07Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. commit 9da78fa08688b691a954da164e6c8d28abc90500 Author: Ishita Mandhan Date: 2016-06-24T00:41:12Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. commit 8d157546152fc063a2aff92a3fade1b6947b5ffb Author: Ishita Mandhan Date: 2016-06-24T00:51:20Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created commit f50c8dce19018e7f689d318795eb797a7d0d0f2d Author: Ishita Mandhan Date: 2016-06-28T00:53:33Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created commit 7815008eeb4c2dabaf96707652f50425ac4d5923 Author: Ishita Mandhan Date: 2016-06-28T20:13:51Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created commit 2f2eca8091ef576e2f9c79859c7404b8d50733d7 Author: Ishita Mandhan Date: 2016-07-11T22:53:35Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362787#comment-15362787 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1548 > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362788#comment-15362788 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user imandhan reopened a pull request: https://github.com/apache/kafka/pull/1548 KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. You can merge this pull request into a Git repository by running: $ git pull https://github.com/imandhan/kafka KAFKA-2857 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1548.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1548 commit c27df5a17a6bbb34a6118bb7b74d6f3e80239612 Author: Ishita MandhanDate: 2016-06-23T23:46:07Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. commit 9da78fa08688b691a954da164e6c8d28abc90500 Author: Ishita Mandhan Date: 2016-06-24T00:41:12Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. commit 8d157546152fc063a2aff92a3fade1b6947b5ffb Author: Ishita Mandhan Date: 2016-06-24T00:51:20Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created commit f50c8dce19018e7f689d318795eb797a7d0d0f2d Author: Ishita Mandhan Date: 2016-06-28T00:53:33Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created commit 7815008eeb4c2dabaf96707652f50425ac4d5923 Author: Ishita Mandhan Date: 2016-06-28T20:13:51Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358012#comment-15358012 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user imandhan reopened a pull request: https://github.com/apache/kafka/pull/1548 KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. You can merge this pull request into a Git repository by running: $ git pull https://github.com/imandhan/kafka KAFKA-2857 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1548.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1548 commit c27df5a17a6bbb34a6118bb7b74d6f3e80239612 Author: Ishita MandhanDate: 2016-06-23T23:46:07Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. commit 9da78fa08688b691a954da164e6c8d28abc90500 Author: Ishita Mandhan Date: 2016-06-24T00:41:12Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. commit 8d157546152fc063a2aff92a3fade1b6947b5ffb Author: Ishita Mandhan Date: 2016-06-24T00:51:20Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created commit f50c8dce19018e7f689d318795eb797a7d0d0f2d Author: Ishita Mandhan Date: 2016-06-28T00:53:33Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created commit 7815008eeb4c2dabaf96707652f50425ac4d5923 Author: Ishita Mandhan Date: 2016-06-28T20:13:51Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15358011#comment-15358011 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1548 > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347448#comment-15347448 ] Ishita Mandhan commented on KAFKA-2857: --- Thanks [~hachikuji]! I just created a PR for this jira. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347446#comment-15347446 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user imandhan opened a pull request: https://github.com/apache/kafka/pull/1548 KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. You can merge this pull request into a Git repository by running: $ git pull https://github.com/imandhan/kafka KAFKA-2857 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/1548.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1548 commit c27df5a17a6bbb34a6118bb7b74d6f3e80239612 Author: Ishita MandhanDate: 2016-06-23T23:46:07Z KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases when offset topic hasn't been created and consumer group describe command is run, are handled appropriately. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347193#comment-15347193 ] Jason Gustafson commented on KAFKA-2857: [~imandhan] I think maybe it can be even simpler. If the error code returned from the GroupCoordinator request is COORDINATOR_NOT_AVAILABLE, then we can print a message as suggested above. So maybe we just need to change {{findCoordinator}} to return an Option instead of throwing? > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347175#comment-15347175 ] Ishita Mandhan commented on KAFKA-2857: --- So it seems like we need to check if the offsets topic exists or not and we can do this check right before a call to findCoordinator() is made in the describeGroup function() here - https://github.com/apache/kafka/blob/404b696bea58aca17fbe528aed03cb3c94516c39/core/src/main/scala/kafka/admin/AdminClient.scala#L125. If the offsets topic doesn’t exist, we can throw an exception and this is the only check we need to do to resolve the jira based on what I understand. Does this seem like the right approach to take? > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331335#comment-15331335 ] Ismael Juma commented on KAFKA-2857: I'd be OK with just improving the message as Jason suggested. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328866#comment-15328866 ] Jason Gustafson commented on KAFKA-2857: [~vahid] That's a good question. Maybe we can get clarification from [~ijuma] or [~junrao], but the previous sentence in the description suggests maybe the intent is to distinguish the case of a group not existing? I think it would be fine here to give the user a message which tells them that the offsets topic is unavailable and points out that it takes a little time on a new cluster to create it. But if we can't find the coordinator, then there's really no way to know whether the group "exists" or not. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328708#comment-15328708 ] Vahid Hashemian commented on KAFKA-2857: [~hachikuji] Could you also clarify what constitutes the "coordinator doesn't exist" case? The JIRA asks that it is distinguished from when "coordinator is not available". Thanks. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326653#comment-15326653 ] Jason Gustafson commented on KAFKA-2857: [~imandhan] The __consumer_offsets topic is a normal topic, so it can happen that all the partition leaders and replicas are down, in which case we'll return an error saying the group coordinator is not available. The cluster has to be pretty big to hit this, but it can happen. It seems like our choices are basically to either let the command retry on this error, or try to give the user a more helpful message. I'd probably favor the latter. Since the most likely scenario for this case is the one mentioned in the description (where the topic hasn't been created yet), I think it would make sense to mention it explicitly in the message and let the user retry. > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Assignee: Ishita Mandhan >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325152#comment-15325152 ] Ishita Mandhan commented on KAFKA-2857: --- Working on this with [~vahid] and we aren't sure about what the part about all replicas for a offset topic partition being down means. If all __consumer_offsets partitions are down, wouldn't all the brokers be down as well (meaning that all brokers keep the same copy of __consumer_offsets)? > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011425#comment-15011425 ] Ismael Juma commented on KAFKA-2857: cc [~junrao] [~hachikuji] > ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when > describing a non-existent group before the offset topic is created > - > > Key: KAFKA-2857 > URL: https://issues.apache.org/jira/browse/KAFKA-2857 > Project: Kafka > Issue Type: Bug > Components: tools >Reporter: Ismael Juma >Priority: Minor > > If we describe a non-existing group before the offset topic is created, like > the following: > {code} > bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --new-consumer > --describe --group > {code} > We get the following error: > {code} > Error while executing consumer group command The group coordinator is not > available. > org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The > group coordinator is not available. > {code} > The exception is thrown in the `adminClient.describeConsumerGroup` call. We > can't interpret this exception as meaning that the group doesn't exist > because it could also be thrown f all replicas for a offset topic partition > are down (as explained by Jun). > Jun also suggested that we should distinguish if a coordinator is not > available from the case where a coordinator doesn't exist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)