Jason, For some reason I did not receive your earlier response to the thread. I just saw it when I went to https://www.mail-archive.com/dev@kafka.apache.org/msg59608.html In the updated KIP I exposed the capability via KafkaConsumer (your first suggestion), but would be happy to look into adding it to AdminClient in the next round if you think that's the better approach. Thanks. --Vahid
From: Vahid S Hashemian/Silicon Valley/IBM@IBMUS To: dev@kafka.apache.org Date: 11/09/2016 11:12 AM Subject: Re: [DISCUSS] KIP 88: OffsetFetch Protocol Update Hi Jason (et al.), I modified the KIP towards a change in OffsetFetch protocol, as per your suggestion. https://cwiki.apache.org/confluence/display/KAFKA/KIP-88%3A+OffsetFetch+Protocol+Update I'd appreciate it if you could take another look and share your thoughts. Thanks. --Vahid From: Vahid S Hashemian/Silicon Valley/IBM@IBMUS To: dev@kafka.apache.org Date: 11/07/2016 03:28 PM Subject: Re: [DISCUSS] KIP 88: DescribeGroups Protocol Update Hi Jason, Thanks for your feedback. Yes, the intent of the KIP is to make existing offsets of the group available even when there is no active consumers in the group consuming from one or more topic partitions. Your suggestion should also work. I'm not yet sure how to obtain group's all topic partitions and need to look more closely at your 'null=all' suggestion, as I couldn't immediately see an obvious way to extract that info in the OffsetFetch handler. I'll dig deeper. Just a quick note that using the OffsetFetch API would not address the second (but minor) problem described in the current KIP (the dummy group member). I assume that is not a big concern. Thanks. --Vahid From: Jason Gustafson <ja...@confluent.io> To: dev@kafka.apache.org Date: 11/07/2016 09:19 AM Subject: Re: [DISCUSS] KIP 88: DescribeGroups Protocol Update Hey Vahid, Thanks for the KIP. If I understand correctly, the problem is how to fetch existing offsets for a group which has no active members, right? I'm not totally clear why we need to modify the DescribeGroups API in order to achieve this since we already have the OffsetFetch API. I think the limitation currently is that you need to know the partitions to fetch offsets for, but perhaps we could modify it to support the "null=all" semantics that we used for the TopicMetadata API? Thanks, Jason On Thu, Nov 3, 2016 at 11:09 AM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi all, > > I started a new KIP under > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 88%3A+DescribeGroups+Protocol+Update > . > > The KIP is a proposal to update the DescribeGroups protocol to address > KAFKA-3853 (https://issues.apache.org/jira/browse/KAFKA-3853). > > I appreciate your feedback. > > Thanks. > --Vahid > >