Hi, Traditionally we used to publish an announcement on the Apache blog for major and minor releases. Unfortunately the Apache blog is going away so we can't use it anymore. There has been a few discussions on updating our website to have a proper blog (and use a markup language instead of raw HTML) but we've not made much progress yet.
So for 3.5.0, I propose to hard code a blog page with the announcement post. I've opened a PR: https://github.com/apache/kafka-site/pull/516 Please take a look and let me know what you think. Thanks, Mickael On Mon, May 22, 2023 at 3:56 PM Ismael Juma <ism...@juma.me.uk> wrote: > > Makes sense Mickael. Thanks! > > Ismael > > On Mon, May 22, 2023 at 4:56 AM Mickael Maison <mickael.mai...@gmail.com> > wrote: > > > Hi Ismael, > > > > Yes we're getting a bit behind schedule. KAFKA-14980 was a significant > > regression that would have broken a lot of MirrorMaker deployments. > > Chris and I were at Kafka Summit last week, so it took a bit longer to > > fix. > > > > The remaining issues are all about migration and at this point I'm not > > sure we'll fix all of them in this release. We can keep migration in > > early access in 3.5. > > > > I'll start working on RC0 today. If we decide to include some of the > > migration fixes, I'll make another RC. > > > > Thanks, > > Mickael > > > > > > > > On Sat, May 20, 2023 at 5:53 PM Ismael Juma <ism...@juma.me.uk> wrote: > > > > > > Hi Mickael, > > > > > > What's the plan for the first RC? In my opinion, we should really tighten > > > the criteria for what's considered a blocker and release RC0 soon (given > > > where we are timeline wise). > > > > > > Ismael > > > > > > On Sat, May 20, 2023, 8:15 AM Mickael Maison <mickael.mai...@gmail.com> > > > wrote: > > > > > > > Hi Matthias, > > > > > > > > Yes feel free to backport to 3.5. > > > > > > > > Thanks, > > > > Mickael > > > > > > > > On Sat, May 20, 2023 at 12:53 AM Akhilesh Chaganti > > > > <akhilesh....@gmail.com> wrote: > > > > > > > > > > Hi Mickael, > > > > > > > > > > I raised the blockers for AK 3.5 and raised PRs for them. All of > > them are > > > > > in the Zk -> KRaft migration path and critical for the Zk -> KRaft > > > > > migration to be successful. > > > > > KAFKA-15003 <https://issues.apache.org/jira/browse/KAFKA-15003> -- > > Topic > > > > > metadata is not correctly synced with Zookeeper while handling > > snapshot > > > > > during migration (dual write). -- > > > > > KAFKA-15004 <https://issues.apache.org/jira/browse/KAFKA-15004> -- > > > > Config > > > > > changes are not correctly synced with Zookeeper whale handling > > snapshot > > > > > during migration (dual write). -- > > > > > KAFKA-15007 <https://issues.apache.org/jira/browse/KAFKA-15007> -- > > > > > MigrationPropagator may have wrong IBP while sending UMR, LISR > > requests > > > > to > > > > > the Zk Brokers during migration. -- > > > > > > > > > > > > > > > Thanks > > > > > Akhilesh > > > > > > > > > > > > > > > On Fri, May 19, 2023 at 9:28 AM Matthias J. Sax <mj...@apache.org> > > > > wrote: > > > > > > > > > > > Mickael, > > > > > > > > > > > > we included a bug-fix into 3.5, and just discovered a critical bug > > in > > > > > > the fix itself, that would introduce a regression into 3.5. > > > > > > > > > > > > We have already a PR to fix-forward: > > > > > > https://github.com/apache/kafka/pull/13734 > > > > > > > > > > > > As we don't have an RC yet, I would like to cherry-pick this back > > to > > > > 3.5. > > > > > > > > > > > > > > > > > > -Matthias > > > > > > > > > > > > On 5/10/23 1:47 PM, Sophie Blee-Goldman wrote: > > > > > > > Thanks Mickael -- the fix has been merged to 3.5 now > > > > > > > > > > > > > > On Wed, May 10, 2023 at 1:12 AM Mickael Maison < > > > > mickael.mai...@gmail.com > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > >> Hi Sophie, > > > > > > >> > > > > > > >> Yes that's fine, thanks for letting me know! > > > > > > >> > > > > > > >> Mickael > > > > > > >> > > > > > > >> On Tue, May 9, 2023 at 10:54 PM Sophie Blee-Goldman > > > > > > >> <ableegold...@apache.org> wrote: > > > > > > >>> > > > > > > >>> Hey Mickael, I noticed a bug in the new versioned key-value > > byte > > > > store > > > > > > >>> where it's delegating to the wrong API > > > > > > >>> (copy/paste error I assume). I extracted this into its own PR > > > > which I > > > > > > >> think > > > > > > >>> should be included in the 3.5 release. > > > > > > >>> > > > > > > >>> The tests are still running, but it's just a one-liner so I'll > > > > merge it > > > > > > >>> when they're done, and cherrypick to 3.5 if > > > > > > >>> that's ok with you. See > > https://github.com/apache/kafka/pull/13695 > > > > > > >>> > > > > > > >>> Thanks for running the release! > > > > > > >>> > > > > > > >>> On Tue, May 9, 2023 at 1:28 PM Randall Hauch <rha...@gmail.com > > > > > > > wrote: > > > > > > >>> > > > > > > >>>> Thanks, Mickael. > > > > > > >>>> > > > > > > >>>> I've cherry-picked that commit to the `3.5` branch ( > > > > > > >>>> https://issues.apache.org/jira/browse/KAFKA-14974). > > > > > > >>>> > > > > > > >>>> Best regards, > > > > > > >>>> Randall > > > > > > >>>> > > > > > > >>>> On Tue, May 9, 2023 at 2:13 PM Mickael Maison < > > > > > > >> mickael.mai...@gmail.com> > > > > > > >>>> wrote: > > > > > > >>>> > > > > > > >>>>> Hi Randall/Luke, > > > > > > >>>>> > > > > > > >>>>> Yes you can go ahead and merge these into 3.5. I've not > > started > > > > > > >> making > > > > > > >>>>> a release yet because: > > > > > > >>>>> - I found a regression today in MirrorMaker: > > > > > > >>>>> https://issues.apache.org/jira/browse/KAFKA-14980 > > > > > > >>>>> - The 3.5 branch builder job in Jenkins has been disabled: > > > > > > >>>>> https://issues.apache.org/jira/browse/INFRA-24577 > > > > > > >>>>> > > > > > > >>>>> Thanks, > > > > > > >>>>> Mickael > > > > > > >>>>> > > > > > > >>>>> On Tue, May 9, 2023 at 8:40 PM Luke Chen <show...@gmail.com> > > > > wrote: > > > > > > >>>>>> > > > > > > >>>>>> Hi Mickael, > > > > > > >>>>>> > > > > > > >>>>>> Since we haven't had the CR created yet, I'm thinking we > > should > > > > > > >>>> backport > > > > > > >>>>>> this doc improvement to v3.5.0 to make the doc complete. > > > > > > >>>>>> https://github.com/apache/kafka/pull/13660 > > > > > > >>>>>> > > > > > > >>>>>> What do you think? > > > > > > >>>>>> > > > > > > >>>>>> Luke > > > > > > >>>>>> > > > > > > >>>>>> On Sat, May 6, 2023 at 11:31 PM David Arthur < > > mum...@gmail.com> > > > > > > >> wrote: > > > > > > >>>>>> > > > > > > >>>>>>> I resolved these three: > > > > > > >>>>>>> * KAFKA-14840 is merged to trunk and 3.5. I removed the > > 3.4.1 > > > > fix > > > > > > >>>>> version > > > > > > >>>>>>> * KAFKA-14805 is merged to trunk and 3.5 > > > > > > >>>>>>> * KAFKA-14918 is merged to trunk and 3.5 > > > > > > >>>>>>> > > > > > > >>>>>>> KAFKA-14692 (docs issue) is still a not done > > > > > > >>>>>>> > > > > > > >>>>>>> Looks like KAFKA-14084 is now resolved as well (it's in > > trunk > > > > and > > > > > > >>>> 3.5). > > > > > > >>>>>>> > > > > > > >>>>>>> I'll try to find out about KAFKA-14698, I think it's > > likely a > > > > > > >>>> WONTFIX. > > > > > > >>>>>>> > > > > > > >>>>>>> -David > > > > > > >>>>>>> > > > > > > >>>>>>> On Fri, May 5, 2023 at 10:43 AM Mickael Maison < > > > > > > >>>>> mickael.mai...@gmail.com> > > > > > > >>>>>>> wrote: > > > > > > >>>>>>> > > > > > > >>>>>>>> Hi David, > > > > > > >>>>>>>> > > > > > > >>>>>>>> Thanks for the update! > > > > > > >>>>>>>> You still own 4 other tickets targeting 3.5: KAFKA-14840, > > > > > > >>>>> KAFKA-14805, > > > > > > >>>>>>>> KAFKA-14918, KAFKA-14692. Should I move all of them to the > > > > next > > > > > > >>>>>>>> release? > > > > > > >>>>>>>> Also KAFKA-14698 and KAFKA-14084 are somewhat related to > > the > > > > > > >>>>>>>> migration. Should I move them too? > > > > > > >>>>>>>> > > > > > > >>>>>>>> Thanks, > > > > > > >>>>>>>> Mickael > > > > > > >>>>>>>> > > > > > > >>>>>>>> On Fri, May 5, 2023 at 4:27 PM David Arthur > > > > > > >>>>>>>> <david.art...@confluent.io.invalid> wrote: > > > > > > >>>>>>>>> > > > > > > >>>>>>>>> Hey Mickael, my two ZK migration fixes are in 3.5 now. > > > > > > >>>>>>>>> > > > > > > >>>>>>>>> Cheers, > > > > > > >>>>>>>>> David > > > > > > >>>>>>>>> > > > > > > >>>>>>>>> On Fri, May 5, 2023 at 9:37 AM Mickael Maison < > > > > > > >>>>>>> mickael.mai...@gmail.com> > > > > > > >>>>>>>>> wrote: > > > > > > >>>>>>>>> > > > > > > >>>>>>>>>> Hi Divij, > > > > > > >>>>>>>>>> > > > > > > >>>>>>>>>> Some dependencies (ZooKeeper, Snappy, Swagger, zstd, > > etc) > > > > > > >> have > > > > > > >>>>> been > > > > > > >>>>>>>>>> updated since 3.4. > > > > > > >>>>>>>>>> Regarding your PR, I would have been in favor of > > bringing > > > > > > >> this > > > > > > >>>>> to 3.5 > > > > > > >>>>>>>>>> a couple of weeks ago, but we're now a week past code > > > > > > >> freeze > > > > > > >>>> for > > > > > > >>>>> 3.5. > > > > > > >>>>>>>>>> Apart if this fixes CVEs, or significant bugs, I think > > we > > > > > > >>>> should > > > > > > >>>>> only > > > > > > >>>>>>>>>> merge it in trunk. > > > > > > >>>>>>>>>> > > > > > > >>>>>>>>>> Thanks, > > > > > > >>>>>>>>>> Mickael > > > > > > >>>>>>>>>> > > > > > > >>>>>>>>>> On Fri, May 5, 2023 at 1:49 PM Divij Vaidya < > > > > > > >>>>> divijvaidy...@gmail.com > > > > > > >>>>>>>> > > > > > > >>>>>>>>>> wrote: > > > > > > >>>>>>>>>>> > > > > > > >>>>>>>>>>> Hey Mickael > > > > > > >>>>>>>>>>> > > > > > > >>>>>>>>>>> Should we consider performing an update of the minor > > > > > > >> versions > > > > > > >>>>> of > > > > > > >>>>>>> the > > > > > > >>>>>>>>>>> dependencies in 3.5 (per > > > > > > >>>>>>> https://github.com/apache/kafka/pull/13673 > > > > > > >>>>>>>> )? > > > > > > >>>>>>>>>>> > > > > > > >>>>>>>>>>> -- > > > > > > >>>>>>>>>>> Divij Vaidya > > > > > > >>>>>>>>>>> > > > > > > >>>>>>>>>>> > > > > > > >>>>>>>>>>> > > > > > > >>>>>>>>>>> On Tue, May 2, 2023 at 5:48 PM Mickael Maison < > > > > > > >>>>>>>> mickael.mai...@gmail.com> > > > > > > >>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>> > > > > > > >>>>>>>>>>>> Hi Luke, > > > > > > >>>>>>>>>>>> > > > > > > >>>>>>>>>>>> Yes I think it makes sense to backport both to 3.5. > > > > > > >>>>>>>>>>>> > > > > > > >>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>> > > > > > > >>>>>>>>>>>> On Tue, May 2, 2023 at 11:38 AM Luke Chen < > > > > > > >>>> show...@gmail.com > > > > > > >>>>>> > > > > > > >>>>>>>> wrote: > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>> Hi Mickael, > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>> There are 1 bug and 1 improvement that I'd like to > > > > > > >>>>> backport to > > > > > > >>>>>>>> 3.5. > > > > > > >>>>>>>>>>>>> 1. A small improvement for ZK migration based on > > > > > > >>>>> KAFKA-14840 > > > > > > >>>>>>>>>> (mentioned > > > > > > >>>>>>>>>>>>> above in David's mail). PR is already merged to > > > > > > >> trunk. > > > > > > >>>>>>>>>>>>> https://issues.apache.org/jira/browse/KAFKA-14909 > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>> 2. A bug will cause the KRaft controller node to shut > > > > > > >>>> down > > > > > > >>>>>>>>>> unexpectedly. > > > > > > >>>>>>>>>>>> PR > > > > > > >>>>>>>>>>>>> is ready for review. > > > > > > >>>>>>>>>>>>> https://issues.apache.org/jira/browse/KAFKA-14946 > > > > > > >>>>>>>>>>>>> https://github.com/apache/kafka/pull/13653 > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>> Thanks. > > > > > > >>>>>>>>>>>>> Luke > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>> On Fri, Apr 28, 2023 at 4:18 PM Mickael Maison < > > > > > > >>>>>>>>>> mickael.mai...@gmail.com > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>> Hi David, > > > > > > >>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>> Yes you can backport these to 3.5. Let me know > > > > > > >> when you > > > > > > >>>>> are > > > > > > >>>>>>>> done. > > > > > > >>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>> On Thu, Apr 27, 2023 at 9:02 PM David Arthur > > > > > > >>>>>>>>>>>>>> <david.art...@confluent.io.invalid> wrote: > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>> Hey Mickael, > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>> I have one major ZK migration improvement > > > > > > >>>> (KAFKA-14805) > > > > > > >>>>>>> that > > > > > > >>>>>>>>>> landed > > > > > > >>>>>>>>>>>> in > > > > > > >>>>>>>>>>>>>>> trunk this week that I'd like to merge to 3.5 > > > > > > >> (once > > > > > > >>>> we > > > > > > >>>>> fix > > > > > > >>>>>>>> some > > > > > > >>>>>>>>>> test > > > > > > >>>>>>>>>>>>>>> failures it introduced). After that, I have > > > > > > >> another > > > > > > >>>> PR > > > > > > >>>>> for > > > > > > >>>>>>>>>>>> KAFKA-14840 > > > > > > >>>>>>>>>>>>>>> which is essentially a huge bug in the ZK > > > > > > >> migration > > > > > > >>>>> logic > > > > > > >>>>>>>> that > > > > > > >>>>>>>>>> needs > > > > > > >>>>>>>>>>>> to > > > > > > >>>>>>>>>>>>>>> land in 3.5. > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>> > > > > > > >> https://issues.apache.org/jira/browse/KAFKA-14805 > > > > > > >>>>> (done) > > > > > > >>>>>>>>>>>>>>> > > > > > > >> https://issues.apache.org/jira/browse/KAFKA-14840 > > > > > > >>>>> (nearly > > > > > > >>>>>>>> done) > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>> I just wanted to check with you before > > > > > > >> cherry-picking > > > > > > >>>>> these > > > > > > >>>>>>>> to > > > > > > >>>>>>>>>> 3.5 > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>> David > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>> On Mon, Apr 24, 2023 at 1:18 PM Mickael Maison < > > > > > > >>>>>>>>>>>> mickael.mai...@gmail.com > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>> Hi Justine, > > > > > > >>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>> That makes sense. Feel free to revert that > > > > > > >> commit > > > > > > >>>> in > > > > > > >>>>> 3.5. > > > > > > >>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>> On Mon, Apr 24, 2023 at 7:16 PM Mickael Maison > > > > > > >> < > > > > > > >>>>>>>>>>>>>> mickael.mai...@gmail.com> > > > > > > >>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>> Hi Josep, > > > > > > >>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>> Thanks for letting me know! > > > > > > >>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>> On Mon, Apr 24, 2023 at 6:58 PM Justine > > > > > > >> Olshan > > > > > > >>>>>>>>>>>>>>>> <jols...@confluent.io.invalid> wrote: > > > > > > >>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>> Hey Mickael, > > > > > > >>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>> I've just opened a blocker to revert > > > > > > >>>> KAFKA-14561 > > > > > > >>>>> in > > > > > > >>>>>>>> 3.5. > > > > > > >>>>>>>>>> There > > > > > > >>>>>>>>>>>> are > > > > > > >>>>>>>>>>>>>> a > > > > > > >>>>>>>>>>>>>>>> few > > > > > > >>>>>>>>>>>>>>>>>> blocker bugs that I don't think I can fix > > > > > > >>>> before > > > > > > >>>>> the > > > > > > >>>>>>>> code > > > > > > >>>>>>>>>>>> freeze, > > > > > > >>>>>>>>>>>>>> so I > > > > > > >>>>>>>>>>>>>>>>>> think for the quality of the release, we > > > > > > >> should > > > > > > >>>>> just > > > > > > >>>>>>>>>> revert the > > > > > > >>>>>>>>>>>>>> commit. > > > > > > >>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>>>> Justine > > > > > > >>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>> On Fri, Apr 21, 2023 at 1:23 PM Josep Prat > > > > > > >>>>>>>>>>>>>> <josep.p...@aiven.io.invalid > > > > > > >>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>> Hi Mickael, > > > > > > >>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>> Greg Harris managed to fix a flaky test > > > > > > >> in > > > > > > >>>>>>>>>>>>>>>>>>> > > > > > > >> https://github.com/apache/kafka/pull/13575, > > > > > > >>>> I > > > > > > >>>>>>>>>> cherry-picked > > > > > > >>>>>>>>>>>> it > > > > > > >>>>>>>>>>>>>> to > > > > > > >>>>>>>>>>>>>>>> the 3.5 > > > > > > >>>>>>>>>>>>>>>>>>> (and 3.4) branch. I updated the Jira to > > > > > > >>>> reflect > > > > > > >>>>>>> that > > > > > > >>>>>>>> is > > > > > > >>>>>>>>>> now > > > > > > >>>>>>>>>>>>>> fixed on > > > > > > >>>>>>>>>>>>>>>> 3.5.0 > > > > > > >>>>>>>>>>>>>>>>>>> as well as 3.6.0. > > > > > > >>>>>>>>>>>>>>>>>>> Let me know if I forgot anything. > > > > > > >>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>> Best, > > > > > > >>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>> On Fri, Apr 21, 2023 at 3:44 PM Mickael > > > > > > >>>> Maison > > > > > > >>>>> < > > > > > > >>>>>>>>>>>>>>>> mickael.mai...@gmail.com> > > > > > > >>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>> Hi, > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>> Just a quick reminder that code freeze > > > > > > >> is > > > > > > >>>>> next > > > > > > >>>>>>>> week. > > > > > > >>>>>>>>>>>>>>>>>>>> We still have 27 JIRAs targeting 3.5 > > > > > > >> [0] > > > > > > >>>>>>> including > > > > > > >>>>>>>>>> quite a > > > > > > >>>>>>>>>>>> few > > > > > > >>>>>>>>>>>>>> bugs > > > > > > >>>>>>>>>>>>>>>>>>>> and flaky test issues opened recently. > > > > > > >> If > > > > > > >>>> you > > > > > > >>>>>>> have > > > > > > >>>>>>>>>> time, > > > > > > >>>>>>>>>>>> take > > > > > > >>>>>>>>>>>>>> one > > > > > > >>>>>>>>>>>>>>>> of > > > > > > >>>>>>>>>>>>>>>>>>>> these items or help with the reviews. > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>> I'll send another update next once > > > > > > >> we've > > > > > > >>>>> entered > > > > > > >>>>>>>> code > > > > > > >>>>>>>>>>>> freeze. > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>> 0: > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>> > > > > > > >>>>>>>>>> > > > > > > >>>>>>>> > > > > > > >>>>>>> > > > > > > >>>>> > > > > > > >>>> > > > > > > >> > > > > > > > > > > > > https://issues.apache.org/jira/browse/KAFKA-13421?jql=project%20%3D%20KAFKA%20AND%20fixVersion%20%3D%203.5.0%20AND%20status%20not%20in%20(resolved%2C%20closed)%20ORDER%20BY%20priority%20DESC%2C%20status%20DESC%2C%20updated%20DESC > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>> On Thu, Apr 20, 2023 at 9:14 PM Mickael > > > > > > >>>>> Maison < > > > > > > >>>>>>>>>>>>>>>> mickael.mai...@gmail.com > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>> Hi Ron, > > > > > > >>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>> Yes feel free to merge that fix. > > > > > > >> Thanks > > > > > > >>>> for > > > > > > >>>>>>>> letting > > > > > > >>>>>>>>>> me > > > > > > >>>>>>>>>>>> know! > > > > > > >>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>> On Thu, Apr 20, 2023 at 8:15 PM Ron > > > > > > >>>>> Dagostino < > > > > > > >>>>>>>>>>>>>> rndg...@gmail.com > > > > > > >>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>> Hi Mickael. I would like to merge > > > > > > >>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>> https://github.com/apache/kafka/pull/13532 > > > > > > >>>>>>>>>>>> (KAFKA-14887: > > > > > > >>>>>>>>>>>>>> No > > > > > > >>>>>>>>>>>>>>>> shutdown > > > > > > >>>>>>>>>>>>>>>>>>>>>> for ZK session expiration in > > > > > > >> feature > > > > > > >>>>>>>> processing) to > > > > > > >>>>>>>>>>>> the 3.5 > > > > > > >>>>>>>>>>>>>>>> branch. > > > > > > >>>>>>>>>>>>>>>>>>>>>> It is a very small and focused fix > > > > > > >> that > > > > > > >>>>> can > > > > > > >>>>>>>> cause > > > > > > >>>>>>>>>>>>>> unexpected > > > > > > >>>>>>>>>>>>>>>> broker > > > > > > >>>>>>>>>>>>>>>>>>>>>> shutdowns when there is > > > > > > >> instability in > > > > > > >>>>> the > > > > > > >>>>>>>>>>>> connectivity to > > > > > > >>>>>>>>>>>>>>>> ZooKeeper. > > > > > > >>>>>>>>>>>>>>>>>>>>>> The risk is very low. > > > > > > >>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>> Ron > > > > > > >>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>> On Tue, Apr 18, 2023 at 9:57 AM > > > > > > >> Mickael > > > > > > >>>>>>> Maison > > > > > > >>>>>>>> < > > > > > > >>>>>>>>>>>>>>>>>>>> mickael.mai...@gmail.com> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>> Hi David, > > > > > > >>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>> Thanks for the update. I've > > > > > > >> marked > > > > > > >>>>>>>> KAFKA-14869 as > > > > > > >>>>>>>>>>>> fixed > > > > > > >>>>>>>>>>>>>> in > > > > > > >>>>>>>>>>>>>>>> 3.5.0, I > > > > > > >>>>>>>>>>>>>>>>>>>>>>> guess you'll only resolve this > > > > > > >> ticket > > > > > > >>>>> once > > > > > > >>>>>>>> you > > > > > > >>>>>>>>>> merge > > > > > > >>>>>>>>>>>> the > > > > > > >>>>>>>>>>>>>>>> backports > > > > > > >>>>>>>>>>>>>>>>>>> to > > > > > > >>>>>>>>>>>>>>>>>>>>>>> earlier branches. The ticket will > > > > > > >>>> have > > > > > > >>>>> to > > > > > > >>>>>>> be > > > > > > >>>>>>>>>>>> resolved to > > > > > > >>>>>>>>>>>>>> run > > > > > > >>>>>>>>>>>>>>>> the > > > > > > >>>>>>>>>>>>>>>>>>>>>>> release but that should leave you > > > > > > >>>>> enough > > > > > > >>>>>>>> time. > > > > > > >>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>> On Tue, Apr 18, 2023 at 3:42 PM > > > > > > >> David > > > > > > >>>>> Jacot > > > > > > >>>>>>>>>>>>>>>>>>>> <dja...@confluent.io.invalid> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> Hi Mickael, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> FYI - I just merged the two > > > > > > >> PRs for > > > > > > >>>>>>>> KIP-915 to > > > > > > >>>>>>>>>>>>>> trunk/3.5. > > > > > > >>>>>>>>>>>>>>>> We are > > > > > > >>>>>>>>>>>>>>>>>>>> all good. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> Cheers, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> David > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> On Mon, Apr 17, 2023 at 5:10 PM > > > > > > >>>>> Mickael > > > > > > >>>>>>>> Maison > > > > > > >>>>>>>>>> < > > > > > > >>>>>>>>>>>>>>>>>>>> mickael.mai...@gmail.com> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> Hi Chris, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> I was looking at that just > > > > > > >> now! > > > > > > >>>> As > > > > > > >>>>> you > > > > > > >>>>>>>> said, > > > > > > >>>>>>>>>> the > > > > > > >>>>>>>>>>>> PRs > > > > > > >>>>>>>>>>>>>>>> merged > > > > > > >>>>>>>>>>>>>>>>>>>> provide > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> some functionality so I think > > > > > > >>>> it's > > > > > > >>>>> fine > > > > > > >>>>>>>> to > > > > > > >>>>>>>>>>>> deliver > > > > > > >>>>>>>>>>>>>> the > > > > > > >>>>>>>>>>>>>>>> KIP > > > > > > >>>>>>>>>>>>>>>>>>>> across 2 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> releases. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> I left a comment in > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>> https://issues.apache.org/jira/browse/KAFKA-14876 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> to document what's in 3.5. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> On Mon, Apr 17, 2023 at > > > > > > >> 5:05 PM > > > > > > >>>>> Chris > > > > > > >>>>>>>> Egerton > > > > > > >>>>>>>>>>>>>>>>>>>> <chr...@aiven.io.invalid> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> Hi Mickael, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> It looks like we missed the > > > > > > >>>>> feature > > > > > > >>>>>>>> freeze > > > > > > >>>>>>>>>>>> cutoff > > > > > > >>>>>>>>>>>>>> for > > > > > > >>>>>>>>>>>>>>>> part > > > > > > >>>>>>>>>>>>>>>>>>> but > > > > > > >>>>>>>>>>>>>>>>>>>> not all of > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> KIP-875 [1]. The features > > > > > > >> we've > > > > > > >>>>> been > > > > > > >>>>>>>> able > > > > > > >>>>>>>>>> to > > > > > > >>>>>>>>>>>> merge > > > > > > >>>>>>>>>>>>>> so > > > > > > >>>>>>>>>>>>>>>> far are > > > > > > >>>>>>>>>>>>>>>>>>>> the new > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> STOPPED state for > > > > > > >> connectors > > > > > > >>>> [2] > > > > > > >>>>> and > > > > > > >>>>>>>> the > > > > > > >>>>>>>>>> API > > > > > > >>>>>>>>>>>> for > > > > > > >>>>>>>>>>>>>>>> reading > > > > > > >>>>>>>>>>>>>>>>>>>> offsets [3]. The > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> features we have not been > > > > > > >> able > > > > > > >>>> to > > > > > > >>>>>>>> merge yet > > > > > > >>>>>>>>>>>> are the > > > > > > >>>>>>>>>>>>>>>> APIs for > > > > > > >>>>>>>>>>>>>>>>>>>> altering and > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> resetting offsets. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> The already-merged > > > > > > >> features are > > > > > > >>>>>>> useful > > > > > > >>>>>>>> on > > > > > > >>>>>>>>>>>> their own > > > > > > >>>>>>>>>>>>>>>> and I > > > > > > >>>>>>>>>>>>>>>>>>>> believe it > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> should > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> be acceptable to release > > > > > > >> them > > > > > > >>>>>>>> separately > > > > > > >>>>>>>>>> from > > > > > > >>>>>>>>>>>> the > > > > > > >>>>>>>>>>>>>>>>>>>> not-yet-merged ones, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> but > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> wanted to double-check > > > > > > >> with you > > > > > > >>>>> that > > > > > > >>>>>>>> it's > > > > > > >>>>>>>>>>>> alright > > > > > > >>>>>>>>>>>>>> to > > > > > > >>>>>>>>>>>>>>>> split > > > > > > >>>>>>>>>>>>>>>>>>>> this KIP > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> across > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> two or more releases, > > > > > > >> starting > > > > > > >>>>> with > > > > > > >>>>>>>> 3.5.0. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> Cheers, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> Chris > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> [1] - > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>> > > > > > > >>>>>>>>>> > > > > > > >>>>>>>> > > > > > > >>>>>>> > > > > > > >>>>> > > > > > > >>>> > > > > > > >> > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> [2] - > > > > > > >>>>>>>>>>>> https://github.com/apache/kafka/pull/13424 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> [3] - > > > > > > >>>>>>>>>>>> https://github.com/apache/kafka/pull/13434 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Apr 14, 2023 at > > > > > > >>>> 10:13 AM > > > > > > >>>>>>>> Matthias > > > > > > >>>>>>>>>> J. > > > > > > >>>>>>>>>>>> Sax < > > > > > > >>>>>>>>>>>>>>>>>>>> mj...@apache.org> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks a lot! > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> On 4/14/23 5:32 AM, > > > > > > >> Mickael > > > > > > >>>>> Maison > > > > > > >>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Matthias, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>> I merged the PR before > > > > > > >>>>> cutting > > > > > > >>>>>>> the > > > > > > >>>>>>>> 3.5 > > > > > > >>>>>>>>>>>> branch. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Apr 14, 2023 at > > > > > > >>>>> 2:31 PM > > > > > > >>>>>>>> Mickael > > > > > > >>>>>>>>>>>> Maison > > > > > > >>>>>>>>>>>>>> < > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> mickael.mai...@gmail.com> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi David, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> I've created the 3.5 > > > > > > >>>> branch. > > > > > > >>>>>>> Feel > > > > > > >>>>>>>>>> free to > > > > > > >>>>>>>>>>>>>> cherry > > > > > > >>>>>>>>>>>>>>>> pick > > > > > > >>>>>>>>>>>>>>>>>>>> these 2 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> commits > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> when they are ready. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Apr 14, 2023 > > > > > > >> at > > > > > > >>>>> 11:23 AM > > > > > > >>>>>>>>>> Satish > > > > > > >>>>>>>>>>>>>> Duggana > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> < > > > > > > >> satish.dugg...@gmail.com > > > > > > >>>>> > > > > > > >>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks Luke for > > > > > > >> helping > > > > > > >>>>> with > > > > > > >>>>>>> the > > > > > > >>>>>>>>>> reviews > > > > > > >>>>>>>>>>>> and > > > > > > >>>>>>>>>>>>>>>> adding a > > > > > > >>>>>>>>>>>>>>>>>>>> few tests in > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> a > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> couple of PRs. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Mickael, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I raised 3 PRs > > > > > > >> recently > > > > > > >>>> for > > > > > > >>>>>>>> tiered > > > > > > >>>>>>>>>>>> storage, > > > > > > >>>>>>>>>>>>>> one > > > > > > >>>>>>>>>>>>>>>> is > > > > > > >>>>>>>>>>>>>>>>>>>> merged. The > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> other 2 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> PRs are in the > > > > > > >> critical > > > > > > >>>>> path of > > > > > > >>>>>>>>>>>> non-tiered > > > > > > >>>>>>>>>>>>>>>> storage > > > > > > >>>>>>>>>>>>>>>>>>>> changes also. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Especially, in > > > > > > >> consumer > > > > > > >>>>> fetch > > > > > > >>>>>>> and > > > > > > >>>>>>>>>>>> retention > > > > > > >>>>>>>>>>>>>>>> cleanup > > > > > > >>>>>>>>>>>>>>>>>>>> paths. These > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> need > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to be thoroughly > > > > > > >> reviewed > > > > > > >>>>> and > > > > > > >>>>>>>> avoid > > > > > > >>>>>>>>>> any > > > > > > >>>>>>>>>>>>>>>> regressions in > > > > > > >>>>>>>>>>>>>>>>>>>> that area. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> We > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> should merge them to > > > > > > >> the > > > > > > >>>>> trunk > > > > > > >>>>>>> as > > > > > > >>>>>>>>>> soon as > > > > > > >>>>>>>>>>>>>>>> possible to > > > > > > >>>>>>>>>>>>>>>>>>>> make it > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> easier > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to work on follow-up > > > > > > >> PRs. > > > > > > >>>>> IMO, > > > > > > >>>>>>>> we can > > > > > > >>>>>>>>>>>> avoid > > > > > > >>>>>>>>>>>>>>>> merging > > > > > > >>>>>>>>>>>>>>>>>>>> these PRs in > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> 3.5 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> just before the > > > > > > >> release > > > > > > >>>>> without > > > > > > >>>>>>>>>> baking > > > > > > >>>>>>>>>>>> for a > > > > > > >>>>>>>>>>>>>>>> longer > > > > > > >>>>>>>>>>>>>>>>>>>> duration. We > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> can > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> take a call on this > > > > > > >> later > > > > > > >>>>> after > > > > > > >>>>>>>> the > > > > > > >>>>>>>>>>>> reviews > > > > > > >>>>>>>>>>>>>> are > > > > > > >>>>>>>>>>>>>>>> done. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Many of the > > > > > > >> individual > > > > > > >>>>>>>>>> functionalities > > > > > > >>>>>>>>>>>>>> related to > > > > > > >>>>>>>>>>>>>>>>>>> tiered > > > > > > >>>>>>>>>>>>>>>>>>>> storage > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> like > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> default topic based > > > > > > >> RLMM > > > > > > >>>>>>>>>> implementation, > > > > > > >>>>>>>>>>>>>> enhanced > > > > > > >>>>>>>>>>>>>>>>>>>> follower fetch > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> protocol > > > > > > >> implementation > > > > > > >>>> for > > > > > > >>>>>>>> tiered > > > > > > >>>>>>>>>>>> storage, > > > > > > >>>>>>>>>>>>>>>> copying > > > > > > >>>>>>>>>>>>>>>>>>>> remote log > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> segments are merged. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> There are 2 PRs for > > > > > > >>>>> consumer > > > > > > >>>>>>>> fetch > > > > > > >>>>>>>>>> for > > > > > > >>>>>>>>>>>> remote > > > > > > >>>>>>>>>>>>>>>> record > > > > > > >>>>>>>>>>>>>>>>>>>> reads, remote > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> retention cleanup and > > > > > > >>>> topic > > > > > > >>>>>>>> deletion > > > > > > >>>>>>>>>>>>>>>> functionality are > > > > > > >>>>>>>>>>>>>>>>>>>> under > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> review. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I do not think it > > > > > > >> can be > > > > > > >>>>>>>> considered > > > > > > >>>>>>>>>> as an > > > > > > >>>>>>>>>>>>>> early > > > > > > >>>>>>>>>>>>>>>> access > > > > > > >>>>>>>>>>>>>>>>>>>> review even > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> with the 2 PRs in > > > > > > >> review. > > > > > > >>>>> Luke > > > > > > >>>>>>>> and I > > > > > > >>>>>>>>>>>> synced > > > > > > >>>>>>>>>>>>>> up > > > > > > >>>>>>>>>>>>>>>> and > > > > > > >>>>>>>>>>>>>>>>>>>> agreed on the > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> same. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Most of the recent > > > > > > >>>>>>> functionality > > > > > > >>>>>>>> is > > > > > > >>>>>>>>>> added > > > > > > >>>>>>>>>>>>>> with a > > > > > > >>>>>>>>>>>>>>>> few > > > > > > >>>>>>>>>>>>>>>>>>>> unit tests. We > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> plan to have > > > > > > >> follow-up > > > > > > >>>> PRs > > > > > > >>>>> on > > > > > > >>>>>>> the > > > > > > >>>>>>>>>>>> immediate > > > > > > >>>>>>>>>>>>>>>> pending > > > > > > >>>>>>>>>>>>>>>>>>>> items and also > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> raise PRs in the > > > > > > >> next few > > > > > > >>>>> weeks > > > > > > >>>>>>>> on > > > > > > >>>>>>>>>> unit > > > > > > >>>>>>>>>>>>>> tests, > > > > > > >>>>>>>>>>>>>>>>>>>> integration test > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> framework and several > > > > > > >>>>>>> integration > > > > > > >>>>>>>>>> tests > > > > > > >>>>>>>>>>>> for > > > > > > >>>>>>>>>>>>>> many > > > > > > >>>>>>>>>>>>>>>> of > > > > > > >>>>>>>>>>>>>>>>>>> these > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> functionalities tying > > > > > > >>>>> together. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Satish. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, 14 Apr 2023 > > > > > > >> at > > > > > > >>>>> 12:52, > > > > > > >>>>>>>>>> Matthias J. > > > > > > >>>>>>>>>>>>>> Sax < > > > > > > >>>>>>>>>>>>>>>>>>>> mj...@apache.org> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hey Mickael, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> we have one open PR > > > > > > >> for > > > > > > >>>>>>> KIP-914 > > > > > > >>>>>>>>>> left. > > > > > > >>>>>>>>>>>> Would > > > > > > >>>>>>>>>>>>>> be > > > > > > >>>>>>>>>>>>>>>> great > > > > > > >>>>>>>>>>>>>>>>>>> if > > > > > > >>>>>>>>>>>>>>>>>>>> you could > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> merge > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> it before cutting > > > > > > >> the > > > > > > >>>> 3.5 > > > > > > >>>>>>>> branch. > > > > > > >>>>>>>>>> If you > > > > > > >>>>>>>>>>>>>> don't > > > > > > >>>>>>>>>>>>>>>> want to > > > > > > >>>>>>>>>>>>>>>>>>>> merge it > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> and > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> prefer that I > > > > > > >>>> cherry-pick > > > > > > >>>>> it > > > > > > >>>>>>> to > > > > > > >>>>>>>> 3.5 > > > > > > >>>>>>>>>>>> branch > > > > > > >>>>>>>>>>>>>>>> later, also > > > > > > >>>>>>>>>>>>>>>>>>>> works for > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> me. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I did close the > > > > > > >> ticket > > > > > > >>>>> already > > > > > > >>>>>>>> as > > > > > > >>>>>>>>>>>> resolved. > > > > > > >>>>>>>>>>>>>>>> It's just > > > > > > >>>>>>>>>>>>>>>>>>> a > > > > > > >>>>>>>>>>>>>>>>>>>> minor > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> change > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> the > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> KIP. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>> https://github.com/apache/kafka/pull/13565 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks a lot! > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> -Matthias > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On 4/13/23 4:32 AM, > > > > > > >>>> David > > > > > > >>>>>>> Jacot > > > > > > >>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Mickael, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks for the > > > > > > >> heads > > > > > > >>>> up. > > > > > > >>>>> As > > > > > > >>>>>>>> raised > > > > > > >>>>>>>>>> by > > > > > > >>>>>>>>>>>> Jeff > > > > > > >>>>>>>>>>>>>>>> earlier in > > > > > > >>>>>>>>>>>>>>>>>>>> this > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> thread, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> we would > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> like to get the two > > > > > > >>>> small > > > > > > >>>>>>>> patches > > > > > > >>>>>>>>>>>> [1][2] > > > > > > >>>>>>>>>>>>>> for > > > > > > >>>>>>>>>>>>>>>> KIP-915 > > > > > > >>>>>>>>>>>>>>>>>>>> in 3.5. The > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> PRs > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> are in > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> review and I > > > > > > >> should be > > > > > > >>>>> able > > > > > > >>>>>>> to > > > > > > >>>>>>>>>> merge > > > > > > >>>>>>>>>>>> them > > > > > > >>>>>>>>>>>>>> in > > > > > > >>>>>>>>>>>>>>>> the next > > > > > > >>>>>>>>>>>>>>>>>>>> few days. I > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> will > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> cherry-pick them > > > > > > >> to the > > > > > > >>>>>>> release > > > > > > >>>>>>>>>> branch > > > > > > >>>>>>>>>>>> in > > > > > > >>>>>>>>>>>>>> your > > > > > > >>>>>>>>>>>>>>>> create > > > > > > >>>>>>>>>>>>>>>>>>>> it in the > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> meantime. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [1] > > > > > > >>>>>>>>>>>>>> https://github.com/apache/kafka/pull/13511 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2] > > > > > > >>>>>>>>>>>>>> https://github.com/apache/kafka/pull/13526 > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Best, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> David > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Thu, Apr 13, > > > > > > >> 2023 at > > > > > > >>>>>>>> 12:55 PM > > > > > > >>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>> Maison < > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> mickael.mai...@gmail.com > > > > > > >>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Luke, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks for the > > > > > > >> heads > > > > > > >>>> up. > > > > > > >>>>>>> This > > > > > > >>>>>>>>>> would be > > > > > > >>>>>>>>>>>>>> great > > > > > > >>>>>>>>>>>>>>>> to get > > > > > > >>>>>>>>>>>>>>>>>>>> Tiered > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> Storage > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> in > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Early Access. Let > > > > > > >> me > > > > > > >>>>> know if > > > > > > >>>>>>>> you > > > > > > >>>>>>>>>>>> can't get > > > > > > >>>>>>>>>>>>>>>>>>> everything > > > > > > >>>>>>>>>>>>>>>>>>>> done this > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> week. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Thu, Apr 13, > > > > > > >> 2023 > > > > > > >>>> at > > > > > > >>>>>>>> 12:54 PM > > > > > > >>>>>>>>>>>> Mickael > > > > > > >>>>>>>>>>>>>>>> Maison > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> < > > > > > > >>>>> mickael.mai...@gmail.com> > > > > > > >>>>>>>> wrote: > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> We've now reached > > > > > > >>>>> feature > > > > > > >>>>>>>> freeze > > > > > > >>>>>>>>>> for > > > > > > >>>>>>>>>>>>>> 3.5.0. > > > > > > >>>>>>>>>>>>>>>> From > > > > > > >>>>>>>>>>>>>>>>>>> now > > > > > > >>>>>>>>>>>>>>>>>>>> on, only > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> bug > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> fixes and changes > > > > > > >>>>> related > > > > > > >>>>>>> to > > > > > > >>>>>>>>>>>> stabilizing > > > > > > >>>>>>>>>>>>>> the > > > > > > >>>>>>>>>>>>>>>>>>> release > > > > > > >>>>>>>>>>>>>>>>>>>> should be > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> merged. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I plan to create > > > > > > >> the > > > > > > >>>>>>> release > > > > > > >>>>>>>>>> branch > > > > > > >>>>>>>>>>>>>> tomorrow > > > > > > >>>>>>>>>>>>>>>>>>> (Friday > > > > > > >>>>>>>>>>>>>>>>>>>> 14). After > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> this > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> point, you'll > > > > > > >> have to > > > > > > >>>>>>> cherry > > > > > > >>>>>>>> pick > > > > > > >>>>>>>>>>>>>> changes to > > > > > > >>>>>>>>>>>>>>>> the > > > > > > >>>>>>>>>>>>>>>>>>>> release branch > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> when > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> merging a PR. > > > > > > >> I'll > > > > > > >>>> send > > > > > > >>>>>>>> another > > > > > > >>>>>>>>>>>> message > > > > > > >>>>>>>>>>>>>> once > > > > > > >>>>>>>>>>>>>>>> the > > > > > > >>>>>>>>>>>>>>>>>>>> branch has > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> been > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> created. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I've updated the > > > > > > >>>>> release > > > > > > >>>>>>>> plan and > > > > > > >>>>>>>>>>>> started > > > > > > >>>>>>>>>>>>>>>> moving > > > > > > >>>>>>>>>>>>>>>>>>>> KIPs that are > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> not > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> complete to the > > > > > > >>>>> postponed > > > > > > >>>>>>>>>> section. > > > > > > >>>>>>>>>>>> For > > > > > > >>>>>>>>>>>>>> now > > > > > > >>>>>>>>>>>>>>>> I've > > > > > > >>>>>>>>>>>>>>>>>>> kept > > > > > > >>>>>>>>>>>>>>>>>>>> a few KIPs > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>> that > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> are still in > > > > > > >>>> progress. > > > > > > >>>>> If > > > > > > >>>>>>>> they > > > > > > >>>>>>>>>> are > > > > > > >>>>>>>>>>>> not > > > > > > >>>>>>>>>>>>>> fully > > > > > > >>>>>>>>>>>>>>>> merged > > > > > > >>>>>>>>>>>>>>>>>>>> when I > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>> create a > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> branch, I'll mark > > > > > > >>>> them > > > > > > >>>>> as > > > > > > >>>>>>>>>> postponed > > > > > > >>>>>>>>>>>> too. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> The next > > > > > > >> milestone is > > > > > > >>>>> code > > > > > > >>>>>>>>>> freeze on > > > > > > >>>>>>>>>>>>>> April > > > > > > >>>>>>>>>>>>>>>> 26. > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks, > > > > > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Mickael > > > > > > >>>>> > > > >
