[jira] [Commented] (KAFKA-559) Garbage collect old consumer metadata entries
[
https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667548#comment-15667548
]
tony mancill commented on KAFKA-559:
Hi [~ewencp]. The attachment
[KAFKA-559.patch|https://issues.apache.org/jira/secure/attachment/12677332/KAFKA-559.patch]
deletes bin/kafka-cleanup-obsolete-zk-entries.sh in the 3rd patch - I don't
think this is intentional, is it?
{code}
>From 1351639d8e7dc2c4b5e869b05960951a82cc629a Mon Sep 17 00:00:00 2001
From: Ewen Cheslack-Postava
Date: Thu, 23 Oct 2014 15:03:10 -0700
Subject: [PATCH 3/4] Fix naming: entires -> entries.
---
bin/kafka-cleanup-obsolete-zk-entires.sh | 19 --
.../kafka/tools/CleanupObsoleteZkEntires.scala | 331 -
.../kafka/tools/CleanupObsoleteZkEntries.scala | 331 +
3 files changed, 331 insertions(+), 350 deletions(-)
delete mode 100755 bin/kafka-cleanup-obsolete-zk-entires.sh
delete mode 100644
core/src/main/scala/kafka/tools/CleanupObsoleteZkEntires.scala
create mode 100644
core/src/main/scala/kafka/tools/CleanupObsoleteZkEntries.scala
diff --git a/bin/kafka-cleanup-obsolete-zk-entires.sh
b/bin/kafka-cleanup-obsolete-zk-entires.sh
deleted file mode 100755
index f2c0cb8..000
--- a/bin/kafka-cleanup-obsolete-zk-entires.sh
+++ /dev/null
{code}
> Garbage collect old consumer metadata entries
> -
>
> Key: KAFKA-559
> URL: https://issues.apache.org/jira/browse/KAFKA-559
> Project: Kafka
> Issue Type: New Feature
>Reporter: Jay Kreps
>Assignee: Ewen Cheslack-Postava
> Labels: newbie, project
> Attachments: KAFKA-559.patch, KAFKA-559.v1.patch, KAFKA-559.v2.patch
>
>
> Many use cases involve tranient consumers. These consumers create entries
> under their consumer group in zk and maintain offsets there as well. There is
> currently no way to delete these entries. It would be good to have a tool
> that did something like
> bin/delete-obsolete-consumer-groups.sh [--topic t1] --since [date]
> --zookeeper [zk_connect]
> This would scan through consumer group entries and delete any that had no
> offset update since the given date.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-559) Garbage collect old consumer metadata entries
[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185377#comment-14185377 ] Ewen Cheslack-Postava commented on KAFKA-559: - Created reviewboard https://reviews.apache.org/r/27232/diff/ against branch origin/trunk Garbage collect old consumer metadata entries - Key: KAFKA-559 URL: https://issues.apache.org/jira/browse/KAFKA-559 Project: Kafka Issue Type: New Feature Reporter: Jay Kreps Assignee: Tejas Patil Labels: newbie, project Attachments: KAFKA-559.patch, KAFKA-559.v1.patch, KAFKA-559.v2.patch Many use cases involve tranient consumers. These consumers create entries under their consumer group in zk and maintain offsets there as well. There is currently no way to delete these entries. It would be good to have a tool that did something like bin/delete-obsolete-consumer-groups.sh [--topic t1] --since [date] --zookeeper [zk_connect] This would scan through consumer group entries and delete any that had no offset update since the given date. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-559) Garbage collect old consumer metadata entries
[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185380#comment-14185380 ] Ewen Cheslack-Postava commented on KAFKA-559: - This is an updated version of the patch by [~tejas.patil]. I'm pretty sure I've addressed all the issues [~jjkoshy] brought up. Garbage collect old consumer metadata entries - Key: KAFKA-559 URL: https://issues.apache.org/jira/browse/KAFKA-559 Project: Kafka Issue Type: New Feature Reporter: Jay Kreps Assignee: Ewen Cheslack-Postava Labels: newbie, project Attachments: KAFKA-559.patch, KAFKA-559.v1.patch, KAFKA-559.v2.patch Many use cases involve tranient consumers. These consumers create entries under their consumer group in zk and maintain offsets there as well. There is currently no way to delete these entries. It would be good to have a tool that did something like bin/delete-obsolete-consumer-groups.sh [--topic t1] --since [date] --zookeeper [zk_connect] This would scan through consumer group entries and delete any that had no offset update since the given date. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-559) Garbage collect old consumer metadata entries
[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13698307#comment-13698307 ] Joel Koshy commented on KAFKA-559: -- One additional recommendation: support a --dry-run option. Garbage collect old consumer metadata entries - Key: KAFKA-559 URL: https://issues.apache.org/jira/browse/KAFKA-559 Project: Kafka Issue Type: New Feature Reporter: Jay Kreps Assignee: Tejas Patil Labels: project Many use cases involve tranient consumers. These consumers create entries under their consumer group in zk and maintain offsets there as well. There is currently no way to delete these entries. It would be good to have a tool that did something like bin/delete-obsolete-consumer-groups.sh [--topic t1] --since [date] --zookeeper [zk_connect] This would scan through consumer group entries and delete any that had no offset update since the given date. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
