Hi Jun, Thanks. I have cherry-picked https://issues.apache.org/jira/browse/KAFKA-18864 to 4.0.
Best, David On Mon, Mar 3, 2025 at 3:18 PM David Jacot <dja...@confluent.io> wrote: > Hi all, > > I have opened https://github.com/apache/kafka/pull/19080 for Kirk's > logging observation. > > Best, > David > > On Mon, Mar 3, 2025 at 12:22 PM David Jacot <david.ja...@gmail.com> wrote: > >> Hi Bruno, >> >> Please go ahead and cherry-pick it to 4.0. >> >> Best, >> David >> >> On Mon, Mar 3, 2025 at 10:12 AM Bruno Cadonna <cado...@apache.org> wrote: >> > >> > Hi David, >> > >> > we found an issue with Kafka Streams that definitely is a regression. A >> > commit fixed a leak, introduced a bug that prevented Kafka Streams from >> > re-initializing its transactional producer in case the producer is >> > fenced. The consequence of not re-initializing the transactional >> > producer is an infinite loop of ProducerFencedExceptions with >> > corresponding rebalances (approx every min). >> > >> > I opened a PR that reverts the defective commit: >> > https://github.com/apache/kafka/pull/19078 >> > >> > We tested the revert in our internal soak and everything seems fine >> again. >> > >> > May I cherry-pick the revert to 4.0? >> > >> > Best, >> > Bruno >> > >> > On 28.02.25 22:59, Ismael Juma wrote: >> > > Given that this is effectively a documentation fix, a cherry-pick >> makes >> > > sense. >> > > >> > > Ismael >> > > >> > > On Fri, Feb 28, 2025 at 1:30 PM Jun Rao <j...@confluent.io.invalid> >> wrote: >> > > >> > >> Hi, David, >> > >> >> > >> We just fixed https://issues.apache.org/jira/browse/KAFKA-18864. >> Not sure >> > >> if you want to cherry-pick it to 4.0. >> > >> >> > >> Thanks, >> > >> >> > >> Jun >> > >> >> > >> On Thu, Feb 27, 2025 at 7:22 PM Ismael Juma <m...@ismaeljuma.com> >> wrote: >> > >> >> > >>> Thanks for the testing Kirk. Can you please file an issue for the >> > >> repeated >> > >>> log to make sure it doesn't get lost in this thread? >> > >>> >> > >>> Ismael >> > >>> >> > >>> On Thu, Feb 27, 2025 at 2:54 PM Kirk True <k...@kirktrue.pro> >> wrote: >> > >>> >> > >>>> Hi David, >> > >>>> >> > >>>> I focused on testing the clients using Java 11: >> > >>>> >> > >>>> My steps: >> > >>>> >> > >>>> 1. Start the broker via the native Docker image >> > >>>> (apache/kafka-native:4.0.0-rc0) >> > >>>> 2. Wrote a simple client to write and read messages, using >> > >> kafka-clients >> > >>>> 4.0.0 from https://repository.apache.org/content/groups/staging >> > >>>> 3. Ran my client with group.protocol set to CLASSIC >> > >>>> 4. I then ran the client with CONSUMER >> > >>>> 5. Finally, I ran two clients instances in the same consumer >> group, one >> > >>>> with a group.protocol set to CLASSIC and the other with CONSUMER >> > >>>> >> > >>>> Everything worked as expected. >> > >>>> >> > >>>> I did notice the following message showing up repeatedly in the >> broker >> > >>>> logs after my tests completed: >> > >>>> >> > >>>> Generated 0 tombstone records while cleaning up group metadata in 0 >> > >>>> milliseconds. >> > >> (org.apache.kafka.coordinator.group.GroupCoordinatorShard) >> > >>>> >> > >>>> Not sure if that's expected or not. >> > >>>> >> > >>>> Thanks, >> > >>>> Kirk >> > >>>> >> > >>>> On Wed, Feb 26, 2025, at 5:15 PM, Chia-Ping Tsai wrote: >> > >>>>> hi David >> > >>>>> >> > >>>>> I apologize for not testing the release candidate (RC) as I >> focused >> > >> on >> > >>>> reviewing the documentation. I have created tickets to address >> issues >> > >> in >> > >>>> the documentation [0][1][2][3], which will be merged into 4.0 as >> the >> > >> risk >> > >>>> is minimal. >> > >>>>> >> > >>>>> Please let me know if you have any other options for those >> tickets. >> > >>>>> >> > >>>>> [0] https://issues.apache.org/jira/browse/KAFKA-18869 >> > >>>>> [1] https://issues.apache.org/jira/browse/KAFKA-18868 >> > >>>>> [2] https://issues.apache.org/jira/browse/KAFKA-18850 >> > >>>>> [3] https://issues.apache.org/jira/browse/KAFKA-18849 >> > >>>>> >> > >>>>> Best, >> > >>>>> Chia-Ping >> > >>>>> >> > >>>>> On 2025/02/22 10:16:43 David Jacot wrote: >> > >>>>>> Hello Kafka users, developers and client-developers, >> > >>>>>> >> > >>>>>> This is the first candidate for release of Apache Kafka 4.0.0. We >> > >>>>>> still have some remaining blockers but we figured that getting a >> > >>> first >> > >>>>>> release candidate will help the community to test this major >> > >> release. >> > >>>>>> >> > >>>>>> - This is the first release without Apache Zookeeper >> > >>>>>> - The Next Generation of the Consumer Rebalance Protocol is >> > >> Generally >> > >>>> Available >> > >>>>>> - The Transactions Server-Side Defense (Phase 2) is Generally >> > >>> Available >> > >>>>>> - Queues for Kafka is in Early Access >> > >>>>>> - Kafka uses log4j2 >> > >>>>>> - Drop broker and tools support for Java 11 >> > >>>>>> - Remove old client protocol API versions >> > >>>>>> >> > >>>>>> Release notes for the 4.0.0 release: >> > >>>>>> >> > >>>> >> > >>> >> > >> >> https://dist.apache.org/repos/dist/dev/kafka/4.0.0-rc0/RELEASE_NOTES.html >> > >>>>>> >> > >>>>>> *** Please download and test the release. Voting is not necessary >> > >> as >> > >>>>>> we still have blockers. >> > >>>>>> >> > >>>>>> Kafka's KEYS file containing PGP keys we use to sign the release: >> > >>>>>> https://kafka.apache.org/KEYS >> > >>>>>> >> > >>>>>> * Release artifacts to be voted upon (source and binary): >> > >>>>>> https://dist.apache.org/repos/dist/dev/kafka/4.0.0-rc0/ >> > >>>>>> >> > >>>>>> * Docker release artifacts to be voted upon: >> > >>>>>> apache/kafka:4.0.0-rc0 >> > >>>>>> apache/kafka-native:4.0.0-rc0 (Building the native image failed, >> I >> > >>>>>> need to investigate it) >> > >>>>>> >> > >>>>>> * Maven artifacts to be voted upon: >> > >>>>>> >> > >>> >> https://repository.apache.org/content/groups/staging/org/apache/kafka/ >> > >>>>>> >> > >>>>>> * Javadoc: >> > >>>>>> https://dist.apache.org/repos/dist/dev/kafka/4.0.0-rc0/javadoc/ >> > >>>>>> >> > >>>>>> * Tag to be voted upon (off 4.0 branch) is the 4.0.0 tag: >> > >>>>>> https://github.com/apache/kafka/releases/tag/4.0.0-rc0 >> > >>>>>> >> > >>>>>> * Documentation: >> > >>>>>> https://kafka.apache.org/40/documentation.html >> > >>>>>> >> > >>>>>> * Protocol: >> > >>>>>> https://kafka.apache.org/40/protocol.html >> > >>>>>> >> > >>>>>> * Successful CI builds for the 4.0 branch: >> > >>>>>> Unit/integration tests: >> > >>>> https://github.com/apache/kafka/actions/runs/13459676207 >> > >>>>>> System tests: TBD >> > >>>>>> >> > >>>>>> * Successful Docker Image Github Actions Pipeline for 4.0 branch: >> > >>>>>> Docker Build Test Pipeline (JVM): >> > >>>>>> https://github.com/apache/kafka/actions/runs/13471603921 >> > >>>>>> Docker Build Test Pipeline (Native): >> > >>>>>> https://github.com/apache/kafka/actions/runs/13471605941 >> > >>>>>> >> > >>>>>> /************************************** >> > >>>>>> >> > >>>>>> Thanks, >> > >>>>>> David >> > >>>>>> >> > >>>>> >> > >>>> >> > >>> >> > >> >> > > >> > >> >
