GitHub user amethystic opened a pull request:
https://github.com/apache/kafka/pull/2058
kafka-4295: ConsoleConsumer does not delete the temporary group in zookeeper
ConsoleConsumer does not delete the temporary group in zookeeper
Author: [email protected]
Since consumer stop logic and zk node removal code are in separate threads,
so when two threads execute in an interleaving manner, persistent node
'/consumers/' might not be removed for those console consumer groups which do
not specify "group.id". This will pollute Zookeeper with lots of inactive
console consumer offset information.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/amethystic/kafka
kafka-4295_ConsoleCoumer_failed_to_cleanup_zkNodes
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/2058.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2058
----
commit db20e7d9fced365cc2a56ebb66b173c2855fe4bd
Author: amethystic <[email protected]>
Date: 2016-10-24T23:03:28Z
kafka-4295: ConsoleConsumer does not delete the temporary group in zookeeper
Author: [email protected]
Since consumer stop logic and zk node removal code are in separate threads,
so when two threads execute in an interleaving manner, persistent node
'/consumers/' might not be removed for those console consumer groups which do
not specify "group.id". This will pollute Zookeeper with lots of inactive
console consumer offset information.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
