Andrew Olson created KAFKA-1088:
-----------------------------------
Summary: Ability to create a shadow consumer group
Key: KAFKA-1088
URL: https://issues.apache.org/jira/browse/KAFKA-1088
Project: Kafka
Issue Type: New Feature
Components: consumer
Reporter: Andrew Olson
Assignee: Neha Narkhede
Fix For: 0.9
I have a consumer group API request that hopefully can be included in the
client rewrite [1] project: the ability to create a new consumer group that is
initialized to the latest topic/partition offsets of another existing group.
Our use case is being able to inspect an active group's unprocessed messages in
a non-invasive manner from an admin or troubleshooting perspective. This shadow
group would be short-lived and given a randomly generated name. It's nice to
see that we'll be able to designate it as ephemeral as well so that it is
automatically cleaned up.
To obtain this message browsing functionality today with 0.8, we
programmatically copy the group ZK paths prior to activating the "spy" group so
that it only sees the unprocessed messages of the target. Obviously not ideal,
but it worked well as a quick hack since we understand how Kafka writes and
reads the offset data in ZK.
[1] https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite
--
This message was sent by Atlassian JIRA
(v6.1#6144)
