Hi, while implementing KIP-1071 in 4.1 and upcoming 4.2 releases, we found a couple of issues which required some tweaking of the KIP, I want to highlight all changes. The KIP was already updated accordingly:
- Streams group description in Admin API now also exposes currentAssignmentEpoch - In the Interactive Query endpoint information, we differentiate active partitions from standby partitions, as in the classic protocol, and we introduced an additional versioning number (endpointInformationEpoch) to version it. - StreamsGroupDescribe requires DESCRIBE ACL on groups and topics, not READ - Adapted the changes from KIP-1101 (described there) - In the StreamsGroupMetadataValue record, we added fields to store the last assignment configuration, and the last validated topology epoch - In StreamsGroupCurrentMemberAssignmentValue, we track additionally the epoch each task was assigned - We added the configuration group.streams.initial.rebalance.delay.ms, the equivalent of group.initial.rebalance.delay.ms in the classic protocol. - kafka-streams-group.sh got the additional option --all-groups as an alternative to --group We are marking the interfaces, records and RPCs as stable in 4.2. Please let us know if there are any concerns. Thanks, Lucas On Fri, Dec 13, 2024 at 11:10 AM Lucas Brutschy <[email protected]> wrote: > > Thank you all for voting! > > The KIP is now accepted with: > > 3 binding +1 (Sophie, Andrew, Bill). > 2 non-binding +1 (Alieh, Colt). > No -1 or 0 votes. > > We will target 4.1 for a non-production opt-in implementation of this KIP. > > On Tue, Dec 10, 2024 at 1:18 AM Sophie Blee-Goldman > <[email protected]> wrote: > > > > +1 (binding) > > > > Thank you guys for the deep discussion and for carefully considering all > > the details of this new protocol. Looking forward to seeing the KIP in > > action! > > > > -Sophie > > > > On Fri, Dec 6, 2024 at 5:52 AM Andrew Schofield < > > [email protected]> wrote: > > > > > Hi Bruno and Lucas, > > > Thanks for proposing this excellent KIP. > > > > > > +1 (binding) > > > > > > Thanks, > > > Andrew > > > ________________________________________ > > > From: Alieh Saeedi <[email protected]> > > > Sent: 03 December 2024 16:07 > > > To: [email protected] <[email protected]> > > > Subject: Re: [VOTE]: KIP-1071: Streams Rebalance Protocol > > > > > > Thanks for the effort. I really appreciate the time and dedication you put > > > into this. > > > > > > +1(non-binding) > > > > > > Cheers, > > > Alieh > > > > > > On Wed, Nov 27, 2024 at 11:31 AM Bruno Cadonna <[email protected]> wrote: > > > > > > > Hi all, > > > > > > > > We (Lucas and myself) would like to call for a vote on KIP-1071: Streams > > > > Rebalance Protocol: https://cwiki.apache.org/confluence/x/2BCTEg > > > > > > > > Discussion thread: > > > > https://lists.apache.org/thread/h8lfcwm1ljq5d84194jfnqp9wh148r1v > > > > > > > > Best, > > > > Bruno > > > > > > > > > > > > > > >
