Hi David, I have file a patch for quickstart link issue which mentioned by Lianet. https://github.com/apache/kafka-site/pull/670
It should fix the issue. Best, TengYao. Lianet M. <liane...@gmail.com> 於 2025年3月13日 週四 上午8:17寫道: > Hey David, > > Regarding the quickstart it's indeed a linking issue: if we go to the 4.0 > documentation on https://kafka.apache.org/40/documentation.html and then > click on the quickstart linked on the introduction (on "To get hands-on > experience with Kafka, follow the Quickstart > <https://kafka.apache.org/quickstart>."), that's how we land on the > outdated quickstart (but the one on the 4.0 doc left menu is OK). > > Also I filed the jira to fix the test issue for the next release ( > https://issues.apache.org/jira/browse/KAFKA-18973) > > With that it looks good to me. > > +1 (non-binding) > > Thanks for driving this! > Lianet > > > On Wed, Mar 12, 2025 at 7:27 PM Justine Olshan > <jols...@confluent.io.invalid> > wrote: > > > Hi David, > > Let me first say this is so nice to have a single java/scala version in > the > > release artifacts! It makes this validation smoother! > > > > I also: > > * Checked the signatures and checksums of the artifacts > > * Used the pre-built tar to create a cluster, upgrade and downgrade > > transaction version, run some simple transactional benches and verify the > > transactions worked as expected > > * Browsed the api documentation, javadoc > > * Took a quick look at the tests and other jobs you ran as part of the > > release -- +1 to not worrying about the VerificationTool test, last I > > looked at it, the tool was too slow to catch any replication lag, so it > > always failed. > > > > +1 (binding) from me. > > > > Thanks, > > Justine > > > > On Wed, Mar 12, 2025 at 2:22 PM Bruno Cadonna <cado...@apache.org> > wrote: > > > > > Hi David, > > > > > > I did the following: > > > > > > - checked the signatures and checksums of all the release artifacts > > > - built from the source artifacts and ran into the same issue Lianet > > > described. After that I built from source using the 4.0.0-rc3 tag. > > > - ran unit and integration tests > > > - ran through the Kafka quickstart with kafka and kafka-native docker > > > images as well as with broker started from downloaded archive > > > - ran through Streams quickstart with kafka and kafka-native docker > > > images as well as with broker started from downloaded archive > > > > > > All good, except: > > > > > > - the issue building from the source artifact)! > > > - there are some linking issue in the docs as mentioned in my previous > > > e-mail > > > > > > Overall, +1 (binding) > > > > > > Best, > > > Bruno > > > > > > > > > On 12.03.25 21:14, Bruno Cadonna wrote: > > > > Hi David, > > > > > > > > I ran into the same issues as Lianet regading the quickstart. I > believe > > > > there is a linking issue. > > > > > > > > If I go to > > > > > > > > https://kafka.apache.org/40/documentation.html > > > > > > > > and then I click on "get started" -> "quickstart" I end up at the 3.9 > > > > version. The 4.0 version can be found under > > > > > > > > https://kafka.apache.org/40/documentation/#quickstart > > > > > > > > Best, > > > > Bruno > > > > > > > > On 12.03.25 20:30, David Jacot wrote: > > > >> Hi Lianet, > > > >> > > > >> Thanks! > > > >> > > > >> Let’s file a Jira for that test. This is not a blocker but we should > > > >> fix it. > > > >> > > > >> Regarding the quick start, are you sure that you used the staged > > > >> documentation for 4.0? Here: > > > >> https://kafka.apache.org/40/documentation.html > > > >> > > > >> Best, > > > >> David > > > >> > > > >> Le mer. 12 mars 2025 à 20:07, Lianet M. <liane...@gmail.com> a > écrit > > : > > > >> > > > >>> Hi David, > > > >>> > > > >>> I've tested the RC3 and this is what I've done so far and what I've > > > >>> found: > > > >>> > > > >>> - build from src kafka-4.0.0-src.tgz with Java 17 > > > >>> - run unit test and integration tests > > > >>> - run client examples from the examples module (consume/produce/tx) > > > >>> - build clients with Java 11. Run client unit tests, integration > > > >>> tests, and > > > >>> examples as above > > > >>> - Followed the quickstart guide to start a broker > > > >>> - Played with command line tools to consume, produce, manage topics > > > >>> - Tried out the new regex validator tool > > > >>> > > > >>> All good with the above steps, with these findings: > > > >>> > > > >>> - When running unit and integration tests on the downloaded > > > >>> kafka-4.0.0-src.tgz, I got some failures that recovered as TengYao > > > >>> mentioned, but I noticed a persistent failure locally, in > > > >>> MetadataSchemaCheckerToolTest.testVerifyEvolutionGit. This test was > > > >>> added > > > >>> in 4.0, and requires a git repo setup, so fails with: > > > >>> *java.lang.RuntimeException: > > > >>> Invalid directory, need to be within a Git repository*. This means > > that > > > >>> building and running the tests straight from a downloaded kafka src > > > >>> folder > > > >>> doesn't work anymore. It used to work with previous versions (ie. > > 3.9, > > > I > > > >>> checked again just in case), because this test didn't exist. If > this > > > was > > > >>> intentional I would expect we need to explain it somewhere, but > can't > > > >>> find > > > >>> anything about it. Am I missing something? > > > >>> - The quickstart https://kafka.apache.org/quickstart still has > > > >>> sections to > > > >>> start/stop Zookeeper (same for Streams Quickstart). > > > >>> - Also the quickstart has invalid commands to format log > directories > > > and > > > >>> start the server (pointing to wrong server.properties location > under > > > >>> /kraft). It's OK on the README. > > > >>> > > > >>> Best, > > > >>> Lianet > > > >>> > > > >>> On Wed, Mar 12, 2025 at 10:41 AM David Jacot < > david.ja...@gmail.com> > > > >>> wrote: > > > >>> > > > >>>> Hi all, > > > >>>> > > > >>>> All the documentation blockers are now closed. Let's continue the > > > >>>> validation process. I don't expect to cut a new RC unless we find > a > > > >>>> non-documentation blocker. > > > >>>> > > > >>>> Best, > > > >>>> David > > > >>>> > > > >>>> On Wed, Mar 12, 2025 at 3:37 PM David Jacot < > david.ja...@gmail.com> > > > >>> wrote: > > > >>>>> > > > >>>>> Awesome, thanks! I just merged it. > > > >>>>> > > > >>>>> Best, > > > >>>>> David > > > >>>>> > > > >>>>> On Wed, Mar 12, 2025 at 3:33 PM 黃竣陽 <s7133...@gmail.com> wrote: > > > >>>>>> > > > >>>>>> Hello David, > > > >>>>>> > > > >>>>>> FYI, https://github.com/apache/kafka-site/pull/669 this PR > > resolve > > > >>>> “1.7 Compatibility” section is empty. > > > >>>>>> > > > >>>>>> Best, > > > >>>>>> Jiunn-Yang > > > >>>>>> > > > >>>>>>> David Jacot <david.ja...@gmail.com> 於 2025年3月12日 晚上10:15 寫 > > > >>>>>>> 道: > > > >>>>>>> > > > >>>>>>> Hi all, > > > >>>>>>> > > > >>>>>>> FYI - I just updated the documentation. The "1.7 Compatibility" > > > >>>>>>> section is empty. Looking into it. > > > >>>>>>> > > > >>>>>>> Best, > > > >>>>>>> David > > > >>>>>>> > > > >>>>>>> On Wed, Mar 12, 2025 at 1:51 PM David Jacot > > > >>>> <dja...@confluent.io.invalid> wrote: > > > >>>>>>>> > > > >>>>>>>> Hi, > > > >>>>>>>> > > > >>>>>>>> Thanks for pointing that out. I will update the documentation > by > > > >>>> the end of > > > >>>>>>>> the day. > > > >>>>>>>> > > > >>>>>>>> Best, > > > >>>>>>>> David > > > >>>>>>>> > > > >>>>>>>> On Wed, Mar 12, 2025 at 1:15 PM TengYao Chi < > > kiting...@gmail.com> > > > >>>> wrote: > > > >>>>>>>> > > > >>>>>>>>> Hi Federico > > > >>>>>>>>> > > > >>>>>>>>> The issue you mentioned has been resolved by > > > >>>>>>>>> https://github.com/apache/kafka/pull/19146 > > > >>>>>>>>> > > > >>>>>>>>> Best, > > > >>>>>>>>> TengYao > > > >>>>>>>>> > > > >>>>>>>>> > > > >>>>>>>>> Federico Valeri <fedeval...@gmail.com> 於 2025年3月12日 週三 下 > > > >>>>>>>>> 午7:32寫道: > > > >>>>>>>>> > > > >>>>>>>>>> Hi David, in the doc menu I see the item "1.6 Differences > > > >>> Between > > > >>>>>>>>>> KRaft mode and ZooKeeper mode", but paragraph 1.6 talks > about > > > >>>> Docker. > > > >>>>>>>>>> Is this supposed to be there? > > > >>>>>>>>>> > > > >>>>>>>>>> On Wed, Mar 12, 2025 at 10:56 AM Luke Chen < > show...@gmail.com > > > > > > >>>> wrote: > > > >>>>>>>>>>> > > > >>>>>>>>>>> Hi David, > > > >>>>>>>>>>> > > > >>>>>>>>>>> Thanks for the analysis. > > > >>>>>>>>>>> > > > >>>>>>>>>>>> * kafkatest.tests.connect.connect_distributed_test - These > > > >>>> tests are > > > >>>>>>>>>> flaky > > > >>>>>>>>>>> in our test infrastructure but they pass locally. > > > >>>>>>>>>>> > > > >>>>>>>>>>> If they can be passed locally, it should be fine. > > > >>>>>>>>>>> > > > >>>>>>>>>>>> * kafkatest.tests.core.network_degrade_test - This is not > a > > > >>>> blocker > > > >>>>>>>>> as > > > >>>>>>>>>> it > > > >>>>>>>>>>> does not test any Kafka bits besides Trogdor. > > > >>>>>>>>>>> > > > >>>>>>>>>>> Hmm... from the test description, it is indeed not related > to > > > >>>> kafka > > > >>>>>>>>>> itself. > > > >>>>>>>>>>> But since we did huge change in this release, I'd like to > be > > > >>> more > > > >>>>>>>>>> careful. > > > >>>>>>>>>>> I'll try to run this test suite in our internal environment > > > >>>> again and > > > >>>>>>>>>>> report the results here. > > > >>>>>>>>>>> > > > >>>>>>>>>>>> * kafkatest.tests.tools.replica_verification_test - It has > > > >>> been > > > >>>>>>>>> failing > > > >>>>>>>>>>> for > > > >>>>>>>>>>> a while. The tool is deprecated and not really used so I > > don't > > > >>>> consider > > > >>>>>>>>>> it > > > >>>>>>>>>>> as a blocker. However, there is already a PR inflight to > > > >>> improve > > > >>>> it. > > > >>>>>>>>>>> > > > >>>>>>>>>>> Sounds good to me. > > > >>>>>>>>>>> > > > >>>>>>>>>>> > > > >>>>>>>>>>> Thanks. > > > >>>>>>>>>>> Luke > > > >>>>>>>>>>> > > > >>>>>>>>>>> On Tue, Mar 11, 2025 at 6:16 PM David Jacot > > > >>>>>>>>> <dja...@confluent.io.invalid > > > >>>>>>>>>>> > > > >>>>>>>>>>> wrote: > > > >>>>>>>>>>> > > > >>>>>>>>>>>> Hi Luke, > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> +1 for backporting > > https://github.com/apache/kafka/pull/19172 > > > >>> . > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> Regarding the system tests, here is my take: > > > >>>>>>>>>>>> * kafkatest.tests.connect.connect_distributed_test - These > > > >>>> tests are > > > >>>>>>>>>> flaky > > > >>>>>>>>>>>> in our test infrastructure but they pass locally. > > > >>>>>>>>>>>> * kafkatest.tests.core.network_degrade_test - This is not > a > > > >>>> blocker > > > >>>>>>>>> as > > > >>>>>>>>>> it > > > >>>>>>>>>>>> does not test any Kafka bits besides Trogdor. > > > >>>>>>>>>>>> * kafkatest.tests.tools.replica_verification_test - It has > > > >>> been > > > >>>>>>>>>> failing for > > > >>>>>>>>>>>> a while. The tool is deprecated and not really used so I > > don't > > > >>>>>>>>>> consider it > > > >>>>>>>>>>>> as a blocker. However, there is already a PR inflight to > > > >>>> improve it. > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> Overall, system tests look pretty good to me. Do you > agree? > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> Best, > > > >>>>>>>>>>>> David > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> On Tue, Mar 11, 2025 at 8:53 AM Luke Chen < > > show...@gmail.com> > > > >>>> wrote: > > > >>>>>>>>>>>> > > > >>>>>>>>>>>>> Hi David, > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>>> I saw there are some failed tests in system test > > > >>>>>>>>>>>>> < > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>> > > > >>>>>>>>> > > > >>>> > > > >>> https://confluent-open-source-kafka-branch-builder-system-test- > > > >>> results.s3-us-west-2.amazonaws.com/trunk/2025-03-06--001.ccab7b98- > > > >>> edaa-40c5-b33d-de1650ea767c--1741313025--apache--4.0--43897f84ac/ > > > >>> report.html > > > >>>>>>>>>>>>>> , > > > >>>>>>>>>>>>> what does that mean for this RC? > > > >>>>>>>>>>>>> Are they blockers? Should we file JIRA issues to fix > them? > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>>> Also, I'd like to backport this upgrade doc improvement > PR > > > >>>>>>>>>>>>> <https://github.com/apache/kafka/pull/19172>to 4.0 > branch > > if > > > >>>> you > > > >>>>>>>>>> don't > > > >>>>>>>>>>>>> have > > > >>>>>>>>>>>>> objections. > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>>> Thanks. > > > >>>>>>>>>>>>> Luke > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>>> On Mon, Mar 10, 2025 at 5:52 PM David Jacot > > > >>>>>>>>>> <dja...@confluent.io.invalid > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>>> wrote: > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>>>> Hi Chia-Ping, > > > >>>>>>>>>>>>>> > > > >>>>>>>>>>>>>> Thanks. I will update the documentation soon. > > > >>>>>>>>>>>>>> > > > >>>>>>>>>>>>>> Best, > > > >>>>>>>>>>>>>> David > > > >>>>>>>>>>>>>> > > > >>>>>>>>>>>>>> On Sun, Mar 9, 2025 at 2:43 AM Chia-Ping Tsai < > > > >>>>>>>>> chia7...@apache.org > > > >>>>>>>>>>> > > > >>>>>>>>>>>>> wrote: > > > >>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>> hi David > > > >>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>> I have cherry-pick > > > >>>> https://github.com/apache/kafka/pull/19146 > > > >>>>>>>>>> to 4.0 > > > >>>>>>>>>>>>> to > > > >>>>>>>>>>>>>>> fix the link of https://kafka.apache.org/40/zk2kraft > > > >>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>> Best, > > > >>>>>>>>>>>>>>> Chia-Ping > > > >>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>> On 2025/03/08 10:08:24 David Jacot wrote: > > > >>>>>>>>>>>>>>>> Hello Kafka users, developers and client-developers, > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> This is the third candidate for release of Apache > Kafka > > > >>>>>>>>> 4.0.0. > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> - This is the first release without Apache Zookeeper > > > >>>>>>>>>>>>>>>> - The Next Generation of the Consumer Rebalance > Protocol > > > >>> is > > > >>>>>>>>>>>> Generally > > > >>>>>>>>>>>>>>> Available > > > >>>>>>>>>>>>>>>> - The Transactions Server-Side Defense (Phase 2) is > > > >>>> Generally > > > >>>>>>>>>>>>> Available > > > >>>>>>>>>>>>>>>> - Queues for Kafka is in Early Access > > > >>>>>>>>>>>>>>>> - Kafka uses log4j2 > > > >>>>>>>>>>>>>>>> - Drop broker and tools support for Java 11 > > > >>>>>>>>>>>>>>>> - Remove old client protocol API versions > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> Release notes for the 4.0.0 release: > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>> > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>> > > > >>>>>>>>> > > > >>>> > > > >>> https://dist.apache.org/repos/dist/dev/kafka/4.0.0-rc3/ > > > >>> RELEASE_NOTES.html > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> *** Please download, test and vote by Wed, March 12 > 9am > > PT > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> Kafka's KEYS file containing PGP keys we use to sign > the > > > >>>>>>>>>> release: > > > >>>>>>>>>>>>>>>> https://kafka.apache.org/KEYS > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Release artifacts to be voted upon (source and > > binary): > > > >>>>>>>>>>>>>>>> > https://dist.apache.org/repos/dist/dev/kafka/4.0.0-rc3/ > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Docker release artifacts to be voted upon: > > > >>>>>>>>>>>>>>>> apache/kafka:4.0.0-rc3 > > > >>>>>>>>>>>>>>>> apache/kafka-native:4.0.0-rc3 > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Maven artifacts to be voted upon: > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>> > > > >>>>>>>>>> > > > >>>> > > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Javadoc: > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>> > > https://dist.apache.org/repos/dist/dev/kafka/4.0.0-rc3/javadoc/ > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Tag to be voted upon (off 4.0 branch) is the 4.0.0 > > tag: > > > >>>>>>>>>>>>>>>> > https://github.com/apache/kafka/releases/tag/4.0.0-rc3 > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Documentation: > > > >>>>>>>>>>>>>>>> https://kafka.apache.org/40/documentation.html > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Protocol: > > > >>>>>>>>>>>>>>>> https://kafka.apache.org/40/protocol.html > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Successful CI builds for the 4.0 branch: > > > >>>>>>>>>>>>>>>> Unit/integration tests: > > > >>>>>>>>>>>>>>> > https://github.com/apache/kafka/actions/runs/13730048850 > > > >>>>>>>>>>>>>>>> System tests: > > > >>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>> > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>> > > > >>>>>>>>> > > > >>>> > > > >>> https://confluent-open-source-kafka-branch-builder-system-test- > > > >>> results.s3-us-west-2.amazonaws.com/trunk/2025-03-06--001.ccab7b98- > > > >>> edaa-40c5-b33d-de1650ea767c--1741313025--apache--4.0--43897f84ac/ > > > >>> report.html > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> * Successful Docker Image Github Actions Pipeline for > > 4.0 > > > >>>>>>>>>> branch: > > > >>>>>>>>>>>>>>>> Docker Build Test Pipeline (JVM): > > > >>>>>>>>>>>>>>>> > > https://github.com/apache/kafka/actions/runs/13735818889 > > > >>>>>>>>>>>>>>>> Docker Build Test Pipeline (Native): > > > >>>>>>>>>>>>>>>> > > https://github.com/apache/kafka/actions/runs/13735821944 > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> /************************************** > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> Thanks, > > > >>>>>>>>>>>>>>>> David Jacot > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>>> PS: I used RC3 instead of RC2 by mistake. > > > >>>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>>> > > > >>>>>>>>>>>>>> > > > >>>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>> > > > >>>>>>>>> > > > >>>>>> > > > >>>> > > > >>> > > > >> > > > > > > > > > > > > >