Re: [ANNOUNCE] New committer: Yash Mayya

[Luke Chen]

Congratulations, Yash!

Luke

On Fri, Sep 22, 2023 at 7:16 AM Hector Geraldino (BLOOMBERG/ 919 3RD A) <
hgerald...@bloomberg.net> wrote:

> Congrats! Well deserved
>
> From: dev@kafka.apache.org At: 09/21/23 17:05:01 UTC-4:00To:
> dev@kafka.apache.org
> Cc:  r...@confluent.io.invalid
> Subject: Re: [ANNOUNCE] New committer: Yash Mayya
>
> Congratulations, Yash!
>
> On Thu 21. Sep 2023 at 21.57, Randall Hauch  wrote:
>
> > Congratulations, Yash!
> >
> > On Thu, Sep 21, 2023 at 12:31 PM Satish Duggana <
> satish.dugg...@gmail.com>
> > wrote:
> >
> > > Congratulations Yash!!
> > >
> > > On Thu, 21 Sept 2023 at 22:57, Viktor Somogyi-Vass
> > >  wrote:
> > > >
> > > > Congrats Yash!
> > > >
> > > > On Thu, Sep 21, 2023 at 7:04 PM Josep Prat
>  > >
> > > > wrote:
> > > >
> > > > > Congrats Yash!
> > > > >
> > > > > ———
> > > > > Josep Prat
> > > > >
> > > > > Aiven Deutschland GmbH
> > > > >
> > > > > Alexanderufer 3-7, 10117 Berlin
> > > > >
> > > > > Amtsgericht Charlottenburg, HRB 209739 B
> > > > >
> > > > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > > > >
> > > > > m: +491715557497
> > > > >
> > > > > w: aiven.io
> > > > >
> > > > > e: josep.p...@aiven.io
> > > > >
> > > > > On Thu, Sep 21, 2023, 18:55 Raymond Ng 
> > > wrote:
> > > > >
> > > > > > Congrats Yash! Well-deserved!
> > > > > >
> > > > > > /Ray
> > > > > >
> > > > > > On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
> > > > > > kamal.chandraprak...@gmail.com> wrote:
> > > > > >
> > > > > > > Congratulations Yash!
> > > > > > >
> > > > > > > On Thu, Sep 21, 2023, 22:03 Bill Bejeck 
> > > wrote:
> > > > > > >
> > > > > > > > Congrats Yash!
> > > > > > > >
> > > > > > > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya <
> > > > > divijvaidy...@gmail.com
> > > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Congratulations Yash!
> > > > > > > > >
> > > > > > > > > Divij Vaidya
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar <
> > > sagarmeansoc...@gmail.com>
> > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > Congrats Yash !
> > > > > > > > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin
> > > > > >  > > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Awesome ! Congratulations Yash !!
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> > > > > > > edoardli...@gmail.com
> > > > > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > Congratulations Yash
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna <
> > > > > > cado...@apache.org
> > > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hi all,
> > > > > > > > > > > > >
> > > > > > > > > > > > > The PMC of Apache Kafka is pleased to announce a
> new
> > > Kafka
> > > > > > > > > committer
> > > > > > > > > > > > > Yash Mayya.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Yash's major contributions are around Connect.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Yash authored the following KIPs:
> > > > > > > > > > > > >
> > > > > > > > > > > > > KIP-793: Allow sink connectors to be used with
> > > > > topic-mutating
> > > > > > > > SMTs
> > > > > > > > > > > > > KIP-882: Kafka Connect REST API configuration
> > > validation
> > > > > > > timeout
> > > > > > > > > > > > > improvements
> > > > > > > > > > > > > KIP-970: Deprecate and remove Connect's redundant
> > task
> > > > > > > > > configurations
> > > > > > > > > > > > > endpoint
> > > > > > > > > > > > > KIP-980: Allow creating connectors in a stopped
> state
> > > > > > > > > > > > >
> > > > > > > > > > > > > Overall, Yash is known for insightful and friendly
> > > input to
> > > > > > > > > discussions
> > > > > > > > > > > > > and his high quality contributions.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Congratulations, Yash!
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks,
> > > > > > > > > > > > >
> > > > > > > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > >
> >
>
>
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Luke Chen]

Congratulations, Lukas!

Luke

On Fri, Sep 22, 2023 at 6:53 AM Tom Bentley  wrote:

> Congratulations!
>
> On Fri, 22 Sept 2023 at 09:11, Sophie Blee-Goldman  >
> wrote:
>
> > Congrats Lucas!
> >
>

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #63

[Apache Jenkins Server]

See 

Re: Apache Kafka 3.6.0 release

[Satish Duggana]

Thanks Divij for raising a PR for doc formatting issue.

On Thu, 21 Sep, 2023, 2:22 PM Divij Vaidya,  wrote:

> Hey Satish
>
> I filed a PR to fix the website formatting bug in 3.6 documentation -
> https://github.com/apache/kafka/pull/14419
> Please take a look when you get a chance.
>
> --
> Divij Vaidya
>
> On Tue, Sep 19, 2023 at 5:36 PM Chris Egerton 
> wrote:
> >
> > Hi Satish,
> >
> > I think this qualifies as a blocker. This API has been around for years
> now
> > and, while we don't document it as not exposing duplicates*, it has come
> > with that implicit contract since its inception. More importantly, it has
> > also never exposed plugins that cannot be used on the worker. This change
> > in behavior not only introduces duplicates*, it causes unreachable
> plugins
> > to be displayed. With this in mind, it seems to qualify pretty clearly
> as a
> > regression and we should not put out a release that includes it.
> >
> > * - Really, these aren't duplicates; rather, they're multiple copies of
> the
> > same plugin that come from different locations on the worker
> >
> > Best,
> >
> > Chris
> >
> > On Tue, Sep 19, 2023 at 4:31 AM Satish Duggana  >
> > wrote:
> >
> > > Hi Greg,
> > > Is this API documented that it does not return duplicate entries?
> > >
> > > Can we also get an opinion from PMC/Committers who have KafkaConnect
> > > expertise on whether this issue is a release blocker?
> > >
> > > If we agree that it is not a release blocker then we can have a
> > > release note clarifying this behaviour and add a reference to the JIRA
> > > that follows up on the possible solutions.
> > >
> > > Thanks,
> > > Satish.
> > >
> > >
> > > On Tue, 19 Sept 2023 at 03:29, Greg Harris
> 
> > > wrote:
> > > >
> > > > Hey Satish,
> > > >
> > > > After investigating further, I believe that this is a regression, but
> > > > mostly a cosmetic one.
> > > > I don't think there is significant risk of breaking clients with this
> > > > change, but it would be confusing for users, so I'd still like to get
> > > > the fix into the next RC.
> > > > I've opened a PR here: https://github.com/apache/kafka/pull/14398
> and
> > > > I'll work to get it merged promptly.
> > > >
> > > > Thanks!
> > > >
> > > > On Mon, Sep 18, 2023 at 11:54 AM Greg Harris 
> > > wrote:
> > > > >
> > > > > Hi Satish,
> > > > >
> > > > > While validating 3.6.0-rc0, I noticed this regression as compared
> to
> > > > > 3.5.1: https://issues.apache.org/jira/browse/KAFKA-15473
> > > > >
> > > > > Impact: The `connector-plugins` endpoint lists duplicates which may
> > > > > cause confusion for users, or poor behavior in clients.
> > > > > Using the other REST API endpoints appears unaffected.
> > > > > I'll open a PR for this later today.
> > > > >
> > > > > Thanks,
> > > > > Greg
> > > > >
> > > > > On Thu, Sep 14, 2023 at 11:56 AM Satish Duggana
> > > > >  wrote:
> > > > > >
> > > > > > Thanks Justine for the update. I saw in the morning that these
> > > changes
> > > > > > are pushed to trunk and 3.6.
> > > > > >
> > > > > > ~Satish.
> > > > > >
> > > > > > On Thu, 14 Sept 2023 at 21:54, Justine Olshan
> > > > > >  wrote:
> > > > > > >
> > > > > > > Hi Satish,
> > > > > > > We were able to merge
> > > > > > > https://issues.apache.org/jira/browse/KAFKA-15459 yesterday
> > > > > > > and pick to 3.6.
> > > > > > >
> > > > > > > Hopefully nothing more from me on this release.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Justine
> > > > > > >
> > > > > > > On Wed, Sep 13, 2023 at 9:51 PM Satish Duggana <
> > > satish.dugg...@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Thanks Luke for the update.
> > > > > > > >
> > > > > > > > ~Satish.
> > > > > > > >
> > > > > > > > On Thu, 14 Sept 2023 at 07:29, Luke Chen 
> > > wrote:
> > > > > > > > >
> > > > > > > > > Hi Satish,
> > > > > > > > >
> > > > > > > > > Since this PR:
> > > > > > > > > https://github.com/apache/kafka/pull/14366 only changes
> the
> > > doc, I've
> > > > > > > > > backported to 3.6 branch. FYI.
> > > > > > > > >
> > > > > > > > > Thanks.
> > > > > > > > > Luke
> > > > > > > > >
> > > > > > > > > On Thu, Sep 14, 2023 at 12:15 AM Justine Olshan
> > > > > > > > >  wrote:
> > > > > > > > >
> > > > > > > > > > Hey Satish -- yes, you are correct. KAFKA-15459 only
> affects
> > > 3.6.
> > > > > > > > > > PR should be finalized soon.
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Justine
> > > > > > > > > >
> > > > > > > > > > On Wed, Sep 13, 2023 at 1:41 AM Federico Valeri <
> > > fedeval...@gmail.com>
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Hi Satish, this is a small documentation fix about ZK
> to
> > > KRaft
> > > > > > > > > > > migration, that we would like to backport to 3.5 and
> 3.6
> > > branches.
> > > > > > > > Are
> > > > > > > > > > > you ok with that?
> > > > > > > > > > >
> > > > > > > > > > > https://github.com/apache/kafka/pull/14366
> > > > > > > > > > >
> > > > > > > > > > > On Wed, Sep 13, 2023 at 

Re: [ANNOUNCE] New committer: Yash Mayya

[Hector Geraldino (BLOOMBERG/ 919 3RD A)]

Congrats! Well deserved

From: dev@kafka.apache.org At: 09/21/23 17:05:01 UTC-4:00To:  
dev@kafka.apache.org
Cc:  r...@confluent.io.invalid
Subject: Re: [ANNOUNCE] New committer: Yash Mayya

Congratulations, Yash!

On Thu 21. Sep 2023 at 21.57, Randall Hauch  wrote:

> Congratulations, Yash!
>
> On Thu, Sep 21, 2023 at 12:31 PM Satish Duggana 
> wrote:
>
> > Congratulations Yash!!
> >
> > On Thu, 21 Sept 2023 at 22:57, Viktor Somogyi-Vass
> >  wrote:
> > >
> > > Congrats Yash!
> > >
> > > On Thu, Sep 21, 2023 at 7:04 PM Josep Prat  >
> > > wrote:
> > >
> > > > Congrats Yash!
> > > >
> > > > ———
> > > > Josep Prat
> > > >
> > > > Aiven Deutschland GmbH
> > > >
> > > > Alexanderufer 3-7, 10117 Berlin
> > > >
> > > > Amtsgericht Charlottenburg, HRB 209739 B
> > > >
> > > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > > >
> > > > m: +491715557497
> > > >
> > > > w: aiven.io
> > > >
> > > > e: josep.p...@aiven.io
> > > >
> > > > On Thu, Sep 21, 2023, 18:55 Raymond Ng 
> > wrote:
> > > >
> > > > > Congrats Yash! Well-deserved!
> > > > >
> > > > > /Ray
> > > > >
> > > > > On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
> > > > > kamal.chandraprak...@gmail.com> wrote:
> > > > >
> > > > > > Congratulations Yash!
> > > > > >
> > > > > > On Thu, Sep 21, 2023, 22:03 Bill Bejeck 
> > wrote:
> > > > > >
> > > > > > > Congrats Yash!
> > > > > > >
> > > > > > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya <
> > > > divijvaidy...@gmail.com
> > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Congratulations Yash!
> > > > > > > >
> > > > > > > > Divij Vaidya
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar <
> > sagarmeansoc...@gmail.com>
> > > > > > wrote:
> > > > > > > > >
> > > > > > > > > Congrats Yash !
> > > > > > > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin
> > > > >  > > > > > >
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Awesome ! Congratulations Yash !!
> > > > > > > > > >
> > > > > > > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> > > > > > edoardli...@gmail.com
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Congratulations Yash
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna <
> > > > > cado...@apache.org
> > > > > > >
> > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > Hi all,
> > > > > > > > > > > >
> > > > > > > > > > > > The PMC of Apache Kafka is pleased to announce a new
> > Kafka
> > > > > > > > committer
> > > > > > > > > > > > Yash Mayya.
> > > > > > > > > > > >
> > > > > > > > > > > > Yash's major contributions are around Connect.
> > > > > > > > > > > >
> > > > > > > > > > > > Yash authored the following KIPs:
> > > > > > > > > > > >
> > > > > > > > > > > > KIP-793: Allow sink connectors to be used with
> > > > topic-mutating
> > > > > > > SMTs
> > > > > > > > > > > > KIP-882: Kafka Connect REST API configuration
> > validation
> > > > > > timeout
> > > > > > > > > > > > improvements
> > > > > > > > > > > > KIP-970: Deprecate and remove Connect's redundant
> task
> > > > > > > > configurations
> > > > > > > > > > > > endpoint
> > > > > > > > > > > > KIP-980: Allow creating connectors in a stopped state
> > > > > > > > > > > >
> > > > > > > > > > > > Overall, Yash is known for insightful and friendly
> > input to
> > > > > > > > discussions
> > > > > > > > > > > > and his high quality contributions.
> > > > > > > > > > > >
> > > > > > > > > > > > Congratulations, Yash!
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > >
> > > > > > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> >
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Tom Bentley]

Congratulations!

On Fri, 22 Sept 2023 at 09:11, Jorge Esteban Quilcate Otoya <
quilcate.jo...@gmail.com> wrote:

> Congratulations, Yash!
>
> On Thu 21. Sep 2023 at 21.57, Randall Hauch  wrote:
>
> > Congratulations, Yash!
> >
> > On Thu, Sep 21, 2023 at 12:31 PM Satish Duggana <
> satish.dugg...@gmail.com>
> > wrote:
> >
> > > Congratulations Yash!!
> > >
> > > On Thu, 21 Sept 2023 at 22:57, Viktor Somogyi-Vass
> > >  wrote:
> > > >
> > > > Congrats Yash!
> > > >
> > > > On Thu, Sep 21, 2023 at 7:04 PM Josep Prat
>  > >
> > > > wrote:
> > > >
> > > > > Congrats Yash!
> > > > >
> > > > > ———
> > > > > Josep Prat
> > > > >
> > > > > Aiven Deutschland GmbH
> > > > >
> > > > > Alexanderufer 3-7, 10117 Berlin
> > > > >
> > > > > Amtsgericht Charlottenburg, HRB 209739 B
> > > > >
> > > > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > > > >
> > > > > m: +491715557497
> > > > >
> > > > > w: aiven.io
> > > > >
> > > > > e: josep.p...@aiven.io
> > > > >
> > > > > On Thu, Sep 21, 2023, 18:55 Raymond Ng 
> > > wrote:
> > > > >
> > > > > > Congrats Yash! Well-deserved!
> > > > > >
> > > > > > /Ray
> > > > > >
> > > > > > On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
> > > > > > kamal.chandraprak...@gmail.com> wrote:
> > > > > >
> > > > > > > Congratulations Yash!
> > > > > > >
> > > > > > > On Thu, Sep 21, 2023, 22:03 Bill Bejeck 
> > > wrote:
> > > > > > >
> > > > > > > > Congrats Yash!
> > > > > > > >
> > > > > > > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya <
> > > > > divijvaidy...@gmail.com
> > > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Congratulations Yash!
> > > > > > > > >
> > > > > > > > > Divij Vaidya
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar <
> > > sagarmeansoc...@gmail.com>
> > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > Congrats Yash !
> > > > > > > > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin
> > > > > >  > > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Awesome ! Congratulations Yash !!
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> > > > > > > edoardli...@gmail.com
> > > > > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > Congratulations Yash
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna <
> > > > > > cado...@apache.org
> > > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hi all,
> > > > > > > > > > > > >
> > > > > > > > > > > > > The PMC of Apache Kafka is pleased to announce a
> new
> > > Kafka
> > > > > > > > > committer
> > > > > > > > > > > > > Yash Mayya.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Yash's major contributions are around Connect.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Yash authored the following KIPs:
> > > > > > > > > > > > >
> > > > > > > > > > > > > KIP-793: Allow sink connectors to be used with
> > > > > topic-mutating
> > > > > > > > SMTs
> > > > > > > > > > > > > KIP-882: Kafka Connect REST API configuration
> > > validation
> > > > > > > timeout
> > > > > > > > > > > > > improvements
> > > > > > > > > > > > > KIP-970: Deprecate and remove Connect's redundant
> > task
> > > > > > > > > configurations
> > > > > > > > > > > > > endpoint
> > > > > > > > > > > > > KIP-980: Allow creating connectors in a stopped
> state
> > > > > > > > > > > > >
> > > > > > > > > > > > > Overall, Yash is known for insightful and friendly
> > > input to
> > > > > > > > > discussions
> > > > > > > > > > > > > and his high quality contributions.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Congratulations, Yash!
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks,
> > > > > > > > > > > > >
> > > > > > > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > >
> >
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Tom Bentley]

Congratulations!

On Fri, 22 Sept 2023 at 09:11, Sophie Blee-Goldman 
wrote:

> Congrats Lucas!
>

Re: [DISCUSS] KIP-979: Allow independently stop KRaft controllers or brokers

[Hailey Ni]

Hi Ron. Thanks for the response. I agree with your point. I'll make the
corresponding changes in the KIP and KAFKA-15471
.

On Thu, Sep 21, 2023 at 1:40 PM Ron Dagostino  wrote:

> Hi Hailey.  No, I just looked, and zookeeper-server-stop does not have
> any facility to be specific about which ZK nodes to signal.  So
> providing the ability in kafka-server-stop to be more specific than
> just "signal all controllers" or "signal all brokers" would be a bonus
> and therefore not necessarily required.  But if it is easy to achieve
> and doesn't add any additional cognitive load -- and at first glance
> it does seem so -- we should probably just support it.
>
> Ron
>
> On Wed, Sep 20, 2023 at 6:15 PM Hailey Ni 
> wrote:
> >
> > Hi Ron,
> >
> > Thank you very much for the comment. I think it makes sense to me that we
> > provide an even more specific way to kill individual controllers/brokers.
> > I have one question: does the command line for ZooKeeper cluster provide
> > such a way to kill individual controllers/brokers?
> >
> > Thanks,
> > Hailey
> >
> > On Tue, Sep 19, 2023 at 11:01 AM Ron Dagostino 
> wrote:
> >
> > > Thanks for the KIP, Hailey.  It will be nice to provide some
> > > fine-grained control for when people running the broker and controller
> > > this way want to stop just one of them.
> > >
> > > One thing that occurs to me is that in a development environment
> > > someone might want to run multiple controllers and multiple brokers
> > > all on the same box, and in that case they might want to actually stop
> > > just one controller or just one broker instead of all of them.  So I'm
> > > wondering if maybe instead of supporting kafka-server-stop
> > > [--process.roles ] we might want to instead support
> > > kafka-server-stop [--required-config ].  If someone wanted
> > > to stop any/all controllers and not touch the broker(s) they could
> > > still achieve that by invoking kafka-server-stop --required-config
> > > process.roles=controller.  But if they did want to stop a particular
> > > controller they could then also achieve that via kafka-server-stop
> > > --required-config node.id=1 (for example).  What do you think?
> > >
> > > Ron
> > >
> > > On Thu, Sep 14, 2023 at 5:56 PM Hailey Ni 
> > > wrote:
> > > >
> > > > Hi all,
> > > >
> > > > I would like to start the discussion about *KIP-979: Allow
> independently
> > > > stop KRaft controllers or brokers* <
> > > >
> > >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-979%3A+Allow+independently+stop+KRaft+controllers+or+brokers
> > > > >
> > > > It proposes adding an optional field "--process.roles " in the
> > > > script to allow users to independently stop either KRaft broker
> processes
> > > > or controller processes. While in the past, all processes were killed
> > > using
> > > > a single script.
> > > > Please let me know if you have any questions or comments. Much
> > > appreciated.
> > > >
> > > > Thanks & Regards,
> > > > Hailey
> > >
>

Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

[Elxan Eminov]

Hi Viktor and huqedi,
I've made the changes to the KIP.
I added the configurable poll interval as an optional - I believe it is
useful to let users to configure it but I doubt whether it would actually
be used.
Please let me know your thoughts on this,
Thanks!

On Sat, 26 Aug 2023 at 15:49, Elxan Eminov  wrote:

> Relatively minor change with a new metric for MM2
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-971%3A+Expose+replication-offset-lag+MirrorMaker2+metric
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Jorge Esteban Quilcate Otoya]

Congratulations, Yash!

On Thu 21. Sep 2023 at 21.57, Randall Hauch  wrote:

> Congratulations, Yash!
>
> On Thu, Sep 21, 2023 at 12:31 PM Satish Duggana 
> wrote:
>
> > Congratulations Yash!!
> >
> > On Thu, 21 Sept 2023 at 22:57, Viktor Somogyi-Vass
> >  wrote:
> > >
> > > Congrats Yash!
> > >
> > > On Thu, Sep 21, 2023 at 7:04 PM Josep Prat  >
> > > wrote:
> > >
> > > > Congrats Yash!
> > > >
> > > > ———
> > > > Josep Prat
> > > >
> > > > Aiven Deutschland GmbH
> > > >
> > > > Alexanderufer 3-7, 10117 Berlin
> > > >
> > > > Amtsgericht Charlottenburg, HRB 209739 B
> > > >
> > > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > > >
> > > > m: +491715557497
> > > >
> > > > w: aiven.io
> > > >
> > > > e: josep.p...@aiven.io
> > > >
> > > > On Thu, Sep 21, 2023, 18:55 Raymond Ng 
> > wrote:
> > > >
> > > > > Congrats Yash! Well-deserved!
> > > > >
> > > > > /Ray
> > > > >
> > > > > On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
> > > > > kamal.chandraprak...@gmail.com> wrote:
> > > > >
> > > > > > Congratulations Yash!
> > > > > >
> > > > > > On Thu, Sep 21, 2023, 22:03 Bill Bejeck 
> > wrote:
> > > > > >
> > > > > > > Congrats Yash!
> > > > > > >
> > > > > > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya <
> > > > divijvaidy...@gmail.com
> > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Congratulations Yash!
> > > > > > > >
> > > > > > > > Divij Vaidya
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar <
> > sagarmeansoc...@gmail.com>
> > > > > > wrote:
> > > > > > > > >
> > > > > > > > > Congrats Yash !
> > > > > > > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin
> > > > >  > > > > > >
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Awesome ! Congratulations Yash !!
> > > > > > > > > >
> > > > > > > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> > > > > > edoardli...@gmail.com
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Congratulations Yash
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna <
> > > > > cado...@apache.org
> > > > > > >
> > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > Hi all,
> > > > > > > > > > > >
> > > > > > > > > > > > The PMC of Apache Kafka is pleased to announce a new
> > Kafka
> > > > > > > > committer
> > > > > > > > > > > > Yash Mayya.
> > > > > > > > > > > >
> > > > > > > > > > > > Yash's major contributions are around Connect.
> > > > > > > > > > > >
> > > > > > > > > > > > Yash authored the following KIPs:
> > > > > > > > > > > >
> > > > > > > > > > > > KIP-793: Allow sink connectors to be used with
> > > > topic-mutating
> > > > > > > SMTs
> > > > > > > > > > > > KIP-882: Kafka Connect REST API configuration
> > validation
> > > > > > timeout
> > > > > > > > > > > > improvements
> > > > > > > > > > > > KIP-970: Deprecate and remove Connect's redundant
> task
> > > > > > > > configurations
> > > > > > > > > > > > endpoint
> > > > > > > > > > > > KIP-980: Allow creating connectors in a stopped state
> > > > > > > > > > > >
> > > > > > > > > > > > Overall, Yash is known for insightful and friendly
> > input to
> > > > > > > > discussions
> > > > > > > > > > > > and his high quality contributions.
> > > > > > > > > > > >
> > > > > > > > > > > > Congratulations, Yash!
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > >
> > > > > > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> >
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Sophie Blee-Goldman]

Congrats Lucas!

Re: [DISCUSS] KIP-979: Allow independently stop KRaft controllers or brokers

[Ron Dagostino]

Hi Hailey.  No, I just looked, and zookeeper-server-stop does not have
any facility to be specific about which ZK nodes to signal.  So
providing the ability in kafka-server-stop to be more specific than
just "signal all controllers" or "signal all brokers" would be a bonus
and therefore not necessarily required.  But if it is easy to achieve
and doesn't add any additional cognitive load -- and at first glance
it does seem so -- we should probably just support it.

Ron

On Wed, Sep 20, 2023 at 6:15 PM Hailey Ni  wrote:
>
> Hi Ron,
>
> Thank you very much for the comment. I think it makes sense to me that we
> provide an even more specific way to kill individual controllers/brokers.
> I have one question: does the command line for ZooKeeper cluster provide
> such a way to kill individual controllers/brokers?
>
> Thanks,
> Hailey
>
> On Tue, Sep 19, 2023 at 11:01 AM Ron Dagostino  wrote:
>
> > Thanks for the KIP, Hailey.  It will be nice to provide some
> > fine-grained control for when people running the broker and controller
> > this way want to stop just one of them.
> >
> > One thing that occurs to me is that in a development environment
> > someone might want to run multiple controllers and multiple brokers
> > all on the same box, and in that case they might want to actually stop
> > just one controller or just one broker instead of all of them.  So I'm
> > wondering if maybe instead of supporting kafka-server-stop
> > [--process.roles ] we might want to instead support
> > kafka-server-stop [--required-config ].  If someone wanted
> > to stop any/all controllers and not touch the broker(s) they could
> > still achieve that by invoking kafka-server-stop --required-config
> > process.roles=controller.  But if they did want to stop a particular
> > controller they could then also achieve that via kafka-server-stop
> > --required-config node.id=1 (for example).  What do you think?
> >
> > Ron
> >
> > On Thu, Sep 14, 2023 at 5:56 PM Hailey Ni 
> > wrote:
> > >
> > > Hi all,
> > >
> > > I would like to start the discussion about *KIP-979: Allow independently
> > > stop KRaft controllers or brokers* <
> > >
> > https://cwiki.apache.org/confluence/display/KAFKA/KIP-979%3A+Allow+independently+stop+KRaft+controllers+or+brokers
> > > >
> > > It proposes adding an optional field "--process.roles " in the
> > > script to allow users to independently stop either KRaft broker processes
> > > or controller processes. While in the past, all processes were killed
> > using
> > > a single script.
> > > Please let me know if you have any questions or comments. Much
> > appreciated.
> > >
> > > Thanks & Regards,
> > > Hailey
> >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #62

[Apache Jenkins Server]

See 

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Tzu-Li (Gordon) Tai]

Congrats Lucas!

On Thu, Sep 21, 2023 at 11:57 AM Randall Hauch  wrote:

> Congratulations, Lucas!
>
> On Thu, Sep 21, 2023 at 12:32 PM Satish Duggana 
> wrote:
>
> > Congratulations Lucas!
> >
> > On Thu, 21 Sept 2023 at 22:58, Viktor Somogyi-Vass
> >  wrote:
> > >
> > > Congrats Lucas!
> > >
> > > On Thu, Sep 21, 2023 at 7:12 PM Alexander Sorokoumov
> > >  wrote:
> > >
> > > > Congratulations, Lucas!
> > > >
> > > > On Thu, Sep 21, 2023 at 10:09 AM Walker Carlson
> > > >  wrote:
> > > >
> > > > > Congrats Lucas!
> > > > >
> > > > > On Thu, Sep 21, 2023 at 11:42 AM Kamal Chandraprakash <
> > > > > kamal.chandraprak...@gmail.com> wrote:
> > > > >
> > > > > > Congrats Lucas!
> > > > > >
> > > > > > On Thu, Sep 21, 2023, 22:05 Boudjelda Mohamed Said <
> > bmsc...@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Congratulations, Lucas!!
> > > > > > >
> > > > > > > On Thu 21 Sep 2023 at 18:34, Lianet M. 
> > wrote:
> > > > > > >
> > > > > > > > Congratulations Lucas!
> > > > > > > >
> > > > > > > > On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna <
> > > > cado...@apache.org>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi all,
> > > > > > > > >
> > > > > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > > > > committer
> > > > > > > > > Lucas Brutschy.
> > > > > > > > >
> > > > > > > > > Lucas' major contributions are around Kafka Streams.
> > > > > > > > >
> > > > > > > > > Lucas' significantly contributed to the state updater
> > > > > > > > > (https://issues.apache.org/jira/browse/KAFKA-10199) and he
> > > > drives
> > > > > > the
> > > > > > > > > implementation of the new threading model for Kafka Streams
> > > > > > > > > (https://issues.apache.org/jira/browse/KAFKA-15326).
> > > > > > > > >
> > > > > > > > > Lucas' contributions to KIP discussions and PR reviews are
> > very
> > > > > > > > thoughtful.
> > > > > > > > >
> > > > > > > > > Congratulations, Lucas!
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > >
> > > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> >
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Randall Hauch]

Congratulations, Yash!

On Thu, Sep 21, 2023 at 12:31 PM Satish Duggana 
wrote:

> Congratulations Yash!!
>
> On Thu, 21 Sept 2023 at 22:57, Viktor Somogyi-Vass
>  wrote:
> >
> > Congrats Yash!
> >
> > On Thu, Sep 21, 2023 at 7:04 PM Josep Prat 
> > wrote:
> >
> > > Congrats Yash!
> > >
> > > ———
> > > Josep Prat
> > >
> > > Aiven Deutschland GmbH
> > >
> > > Alexanderufer 3-7, 10117 Berlin
> > >
> > > Amtsgericht Charlottenburg, HRB 209739 B
> > >
> > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > >
> > > m: +491715557497
> > >
> > > w: aiven.io
> > >
> > > e: josep.p...@aiven.io
> > >
> > > On Thu, Sep 21, 2023, 18:55 Raymond Ng 
> wrote:
> > >
> > > > Congrats Yash! Well-deserved!
> > > >
> > > > /Ray
> > > >
> > > > On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
> > > > kamal.chandraprak...@gmail.com> wrote:
> > > >
> > > > > Congratulations Yash!
> > > > >
> > > > > On Thu, Sep 21, 2023, 22:03 Bill Bejeck 
> wrote:
> > > > >
> > > > > > Congrats Yash!
> > > > > >
> > > > > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya <
> > > divijvaidy...@gmail.com
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Congratulations Yash!
> > > > > > >
> > > > > > > Divij Vaidya
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar <
> sagarmeansoc...@gmail.com>
> > > > > wrote:
> > > > > > > >
> > > > > > > > Congrats Yash !
> > > > > > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin
> > > >  > > > > >
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Awesome ! Congratulations Yash !!
> > > > > > > > >
> > > > > > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> > > > > edoardli...@gmail.com
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Congratulations Yash
> > > > > > > > > >
> > > > > > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna <
> > > > cado...@apache.org
> > > > > >
> > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > Hi all,
> > > > > > > > > > >
> > > > > > > > > > > The PMC of Apache Kafka is pleased to announce a new
> Kafka
> > > > > > > committer
> > > > > > > > > > > Yash Mayya.
> > > > > > > > > > >
> > > > > > > > > > > Yash's major contributions are around Connect.
> > > > > > > > > > >
> > > > > > > > > > > Yash authored the following KIPs:
> > > > > > > > > > >
> > > > > > > > > > > KIP-793: Allow sink connectors to be used with
> > > topic-mutating
> > > > > > SMTs
> > > > > > > > > > > KIP-882: Kafka Connect REST API configuration
> validation
> > > > > timeout
> > > > > > > > > > > improvements
> > > > > > > > > > > KIP-970: Deprecate and remove Connect's redundant task
> > > > > > > configurations
> > > > > > > > > > > endpoint
> > > > > > > > > > > KIP-980: Allow creating connectors in a stopped state
> > > > > > > > > > >
> > > > > > > > > > > Overall, Yash is known for insightful and friendly
> input to
> > > > > > > discussions
> > > > > > > > > > > and his high quality contributions.
> > > > > > > > > > >
> > > > > > > > > > > Congratulations, Yash!
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > >
> > > > > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Randall Hauch]

Congratulations, Lucas!

On Thu, Sep 21, 2023 at 12:32 PM Satish Duggana 
wrote:

> Congratulations Lucas!
>
> On Thu, 21 Sept 2023 at 22:58, Viktor Somogyi-Vass
>  wrote:
> >
> > Congrats Lucas!
> >
> > On Thu, Sep 21, 2023 at 7:12 PM Alexander Sorokoumov
> >  wrote:
> >
> > > Congratulations, Lucas!
> > >
> > > On Thu, Sep 21, 2023 at 10:09 AM Walker Carlson
> > >  wrote:
> > >
> > > > Congrats Lucas!
> > > >
> > > > On Thu, Sep 21, 2023 at 11:42 AM Kamal Chandraprakash <
> > > > kamal.chandraprak...@gmail.com> wrote:
> > > >
> > > > > Congrats Lucas!
> > > > >
> > > > > On Thu, Sep 21, 2023, 22:05 Boudjelda Mohamed Said <
> bmsc...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Congratulations, Lucas!!
> > > > > >
> > > > > > On Thu 21 Sep 2023 at 18:34, Lianet M. 
> wrote:
> > > > > >
> > > > > > > Congratulations Lucas!
> > > > > > >
> > > > > > > On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna <
> > > cado...@apache.org>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > > > committer
> > > > > > > > Lucas Brutschy.
> > > > > > > >
> > > > > > > > Lucas' major contributions are around Kafka Streams.
> > > > > > > >
> > > > > > > > Lucas' significantly contributed to the state updater
> > > > > > > > (https://issues.apache.org/jira/browse/KAFKA-10199) and he
> > > drives
> > > > > the
> > > > > > > > implementation of the new threading model for Kafka Streams
> > > > > > > > (https://issues.apache.org/jira/browse/KAFKA-15326).
> > > > > > > >
> > > > > > > > Lucas' contributions to KIP discussions and PR reviews are
> very
> > > > > > > thoughtful.
> > > > > > > >
> > > > > > > > Congratulations, Lucas!
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > >
> > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>

[GitHub] [kafka-site] mumrah commented on pull request #548: KAFKA-15483 Add KIP-938 and KIP-866 metrics to ops.html

[via GitHub]

mumrah commented on PR #548:
URL: https://github.com/apache/kafka-site/pull/548#issuecomment-1730131962

   Thanks for calling those out, @satishd. I've added them as well.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2221

[Apache Jenkins Server]

See 

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Satish Duggana]

Congratulations Lucas!

On Thu, 21 Sept 2023 at 22:58, Viktor Somogyi-Vass
 wrote:
>
> Congrats Lucas!
>
> On Thu, Sep 21, 2023 at 7:12 PM Alexander Sorokoumov
>  wrote:
>
> > Congratulations, Lucas!
> >
> > On Thu, Sep 21, 2023 at 10:09 AM Walker Carlson
> >  wrote:
> >
> > > Congrats Lucas!
> > >
> > > On Thu, Sep 21, 2023 at 11:42 AM Kamal Chandraprakash <
> > > kamal.chandraprak...@gmail.com> wrote:
> > >
> > > > Congrats Lucas!
> > > >
> > > > On Thu, Sep 21, 2023, 22:05 Boudjelda Mohamed Said 
> > > > wrote:
> > > >
> > > > > Congratulations, Lucas!!
> > > > >
> > > > > On Thu 21 Sep 2023 at 18:34, Lianet M.  wrote:
> > > > >
> > > > > > Congratulations Lucas!
> > > > > >
> > > > > > On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna <
> > cado...@apache.org>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi all,
> > > > > > >
> > > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > > committer
> > > > > > > Lucas Brutschy.
> > > > > > >
> > > > > > > Lucas' major contributions are around Kafka Streams.
> > > > > > >
> > > > > > > Lucas' significantly contributed to the state updater
> > > > > > > (https://issues.apache.org/jira/browse/KAFKA-10199) and he
> > drives
> > > > the
> > > > > > > implementation of the new threading model for Kafka Streams
> > > > > > > (https://issues.apache.org/jira/browse/KAFKA-15326).
> > > > > > >
> > > > > > > Lucas' contributions to KIP discussions and PR reviews are very
> > > > > > thoughtful.
> > > > > > >
> > > > > > > Congratulations, Lucas!
> > > > > > >
> > > > > > > Thanks,
> > > > > > >
> > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >

Re: [ANNOUNCE] New committer: Yash Mayya

[Satish Duggana]

Congratulations Yash!!

On Thu, 21 Sept 2023 at 22:57, Viktor Somogyi-Vass
 wrote:
>
> Congrats Yash!
>
> On Thu, Sep 21, 2023 at 7:04 PM Josep Prat 
> wrote:
>
> > Congrats Yash!
> >
> > ———
> > Josep Prat
> >
> > Aiven Deutschland GmbH
> >
> > Alexanderufer 3-7, 10117 Berlin
> >
> > Amtsgericht Charlottenburg, HRB 209739 B
> >
> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> >
> > m: +491715557497
> >
> > w: aiven.io
> >
> > e: josep.p...@aiven.io
> >
> > On Thu, Sep 21, 2023, 18:55 Raymond Ng  wrote:
> >
> > > Congrats Yash! Well-deserved!
> > >
> > > /Ray
> > >
> > > On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
> > > kamal.chandraprak...@gmail.com> wrote:
> > >
> > > > Congratulations Yash!
> > > >
> > > > On Thu, Sep 21, 2023, 22:03 Bill Bejeck  wrote:
> > > >
> > > > > Congrats Yash!
> > > > >
> > > > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya <
> > divijvaidy...@gmail.com
> > > >
> > > > > wrote:
> > > > >
> > > > > > Congratulations Yash!
> > > > > >
> > > > > > Divij Vaidya
> > > > > >
> > > > > >
> > > > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar 
> > > > wrote:
> > > > > > >
> > > > > > > Congrats Yash !
> > > > > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin
> > >  > > > >
> > > > > > wrote:
> > > > > > >
> > > > > > > > Awesome ! Congratulations Yash !!
> > > > > > > >
> > > > > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> > > > edoardli...@gmail.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Congratulations Yash
> > > > > > > > >
> > > > > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna <
> > > cado...@apache.org
> > > > >
> > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > Hi all,
> > > > > > > > > >
> > > > > > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > > > > > committer
> > > > > > > > > > Yash Mayya.
> > > > > > > > > >
> > > > > > > > > > Yash's major contributions are around Connect.
> > > > > > > > > >
> > > > > > > > > > Yash authored the following KIPs:
> > > > > > > > > >
> > > > > > > > > > KIP-793: Allow sink connectors to be used with
> > topic-mutating
> > > > > SMTs
> > > > > > > > > > KIP-882: Kafka Connect REST API configuration validation
> > > > timeout
> > > > > > > > > > improvements
> > > > > > > > > > KIP-970: Deprecate and remove Connect's redundant task
> > > > > > configurations
> > > > > > > > > > endpoint
> > > > > > > > > > KIP-980: Allow creating connectors in a stopped state
> > > > > > > > > >
> > > > > > > > > > Overall, Yash is known for insightful and friendly input to
> > > > > > discussions
> > > > > > > > > > and his high quality contributions.
> > > > > > > > > >
> > > > > > > > > > Congratulations, Yash!
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > >
> > > > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > > >
> > > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Guozhang Wang]

Congratulations, Lucas!

On Thu, Sep 21, 2023 at 8:45 AM Bruno Cadonna  wrote:
>
> Hi all,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Lucas Brutschy.
>
> Lucas' major contributions are around Kafka Streams.
>
> Lucas' significantly contributed to the state updater
> (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the
> implementation of the new threading model for Kafka Streams
> (https://issues.apache.org/jira/browse/KAFKA-15326).
>
> Lucas' contributions to KIP discussions and PR reviews are very thoughtful.
>
> Congratulations, Lucas!
>
> Thanks,
>
> Bruno (on behalf of the Apache Kafka PMC)

Re: [ANNOUNCE] New committer: Yash Mayya

[Guozhang Wang]

Congrats, Yash!

On Thu, Sep 21, 2023 at 8:28 AM Bruno Cadonna  wrote:
>
> Hi all,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Yash Mayya.
>
> Yash's major contributions are around Connect.
>
> Yash authored the following KIPs:
>
> KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> KIP-882: Kafka Connect REST API configuration validation timeout
> improvements
> KIP-970: Deprecate and remove Connect's redundant task configurations
> endpoint
> KIP-980: Allow creating connectors in a stopped state
>
> Overall, Yash is known for insightful and friendly input to discussions
> and his high quality contributions.
>
> Congratulations, Yash!
>
> Thanks,
>
> Bruno (on behalf of the Apache Kafka PMC)

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Viktor Somogyi-Vass]

Congrats Lucas!

On Thu, Sep 21, 2023 at 7:12 PM Alexander Sorokoumov
 wrote:

> Congratulations, Lucas!
>
> On Thu, Sep 21, 2023 at 10:09 AM Walker Carlson
>  wrote:
>
> > Congrats Lucas!
> >
> > On Thu, Sep 21, 2023 at 11:42 AM Kamal Chandraprakash <
> > kamal.chandraprak...@gmail.com> wrote:
> >
> > > Congrats Lucas!
> > >
> > > On Thu, Sep 21, 2023, 22:05 Boudjelda Mohamed Said 
> > > wrote:
> > >
> > > > Congratulations, Lucas!!
> > > >
> > > > On Thu 21 Sep 2023 at 18:34, Lianet M.  wrote:
> > > >
> > > > > Congratulations Lucas!
> > > > >
> > > > > On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna <
> cado...@apache.org>
> > > > > wrote:
> > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > committer
> > > > > > Lucas Brutschy.
> > > > > >
> > > > > > Lucas' major contributions are around Kafka Streams.
> > > > > >
> > > > > > Lucas' significantly contributed to the state updater
> > > > > > (https://issues.apache.org/jira/browse/KAFKA-10199) and he
> drives
> > > the
> > > > > > implementation of the new threading model for Kafka Streams
> > > > > > (https://issues.apache.org/jira/browse/KAFKA-15326).
> > > > > >
> > > > > > Lucas' contributions to KIP discussions and PR reviews are very
> > > > > thoughtful.
> > > > > >
> > > > > > Congratulations, Lucas!
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Viktor Somogyi-Vass]

Congrats Yash!

On Thu, Sep 21, 2023 at 7:04 PM Josep Prat 
wrote:

> Congrats Yash!
>
> ———
> Josep Prat
>
> Aiven Deutschland GmbH
>
> Alexanderufer 3-7, 10117 Berlin
>
> Amtsgericht Charlottenburg, HRB 209739 B
>
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>
> m: +491715557497
>
> w: aiven.io
>
> e: josep.p...@aiven.io
>
> On Thu, Sep 21, 2023, 18:55 Raymond Ng  wrote:
>
> > Congrats Yash! Well-deserved!
> >
> > /Ray
> >
> > On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
> > kamal.chandraprak...@gmail.com> wrote:
> >
> > > Congratulations Yash!
> > >
> > > On Thu, Sep 21, 2023, 22:03 Bill Bejeck  wrote:
> > >
> > > > Congrats Yash!
> > > >
> > > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya <
> divijvaidy...@gmail.com
> > >
> > > > wrote:
> > > >
> > > > > Congratulations Yash!
> > > > >
> > > > > Divij Vaidya
> > > > >
> > > > >
> > > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar 
> > > wrote:
> > > > > >
> > > > > > Congrats Yash !
> > > > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin
> >  > > >
> > > > > wrote:
> > > > > >
> > > > > > > Awesome ! Congratulations Yash !!
> > > > > > >
> > > > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> > > edoardli...@gmail.com
> > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Congratulations Yash
> > > > > > > >
> > > > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna <
> > cado...@apache.org
> > > >
> > > > > wrote:
> > > > > > > > >
> > > > > > > > > Hi all,
> > > > > > > > >
> > > > > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > > > > committer
> > > > > > > > > Yash Mayya.
> > > > > > > > >
> > > > > > > > > Yash's major contributions are around Connect.
> > > > > > > > >
> > > > > > > > > Yash authored the following KIPs:
> > > > > > > > >
> > > > > > > > > KIP-793: Allow sink connectors to be used with
> topic-mutating
> > > > SMTs
> > > > > > > > > KIP-882: Kafka Connect REST API configuration validation
> > > timeout
> > > > > > > > > improvements
> > > > > > > > > KIP-970: Deprecate and remove Connect's redundant task
> > > > > configurations
> > > > > > > > > endpoint
> > > > > > > > > KIP-980: Allow creating connectors in a stopped state
> > > > > > > > >
> > > > > > > > > Overall, Yash is known for insightful and friendly input to
> > > > > discussions
> > > > > > > > > and his high quality contributions.
> > > > > > > > >
> > > > > > > > > Congratulations, Yash!
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > >
> > > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > > >
> > > > > > >
> > > > >
> > > >
> > >
> >
>

[GitHub] [kafka-site] satishd commented on pull request #548: KAFKA-15483 Add KIP-938 metrics to ops.html

[via GitHub]

satishd commented on PR #548:
URL: https://github.com/apache/kafka-site/pull/548#issuecomment-1729990446

   @mumrah  I do not see the documentation in the latest kafka-site docs for 
the below metrics that are part of KIP-866, correct me if I missed them in the 
existing docs. 
   ```
   ZkWriteBehindLag
   ZkWriteSnapshotTimeMs
   ZkWriteDeltaTimeMs
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [kafka-site] satishd commented on a diff in pull request #548: KAFKA-15483 Add KIP-938 metrics to ops.html

[via GitHub]

satishd commented on code in PR #548:
URL: https://github.com/apache/kafka-site/pull/548#discussion_r160366


##
36/ops.html:
##
@@ -1980,6 +1980,28 @@ <
 The average fraction of time the client's poll() is idle as opposed to 
waiting for the user code to process records.
 kafka.server:type=raft-metrics,name=poll-idle-ratio-avg
   
+  
+Current Metadata Version
+Outputs the feature level of the current effective metadata 
version.
+kafka.server:type=MetadataLoader,name=CurrentMetadataVersion
+  
+  
+Metadata Snapshot Load Count
+The total number of times we have loaded a KRaft snapshot since the 
process was started.
+kafka.server:type=MetadataLoader,name=HandleLoadSnapshotCount
+  
+  
+Latest Metadata Snapshot Size
+The total size in bytes of the latest snapshot that the node has 
generated. If none have been generated yet, this is the size
+of the latest snapshot that was loaded. If no snapshots have been 
generated or loaded, this is 0.
+
kafka.server:type=SnapshotEmitter,name=LatestSnapshotGeneratedBytes
+  
+  
+Latest Metadata Snapshot Age
+The interval in miliseconds since the latest snapshot that the node 
has generated. 

Review Comment:
   nit typo: `miliseconds` -> `milliseconds`



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Alexander Sorokoumov]

Congratulations, Lucas!

On Thu, Sep 21, 2023 at 10:09 AM Walker Carlson
 wrote:

> Congrats Lucas!
>
> On Thu, Sep 21, 2023 at 11:42 AM Kamal Chandraprakash <
> kamal.chandraprak...@gmail.com> wrote:
>
> > Congrats Lucas!
> >
> > On Thu, Sep 21, 2023, 22:05 Boudjelda Mohamed Said 
> > wrote:
> >
> > > Congratulations, Lucas!!
> > >
> > > On Thu 21 Sep 2023 at 18:34, Lianet M.  wrote:
> > >
> > > > Congratulations Lucas!
> > > >
> > > > On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna 
> > > > wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> committer
> > > > > Lucas Brutschy.
> > > > >
> > > > > Lucas' major contributions are around Kafka Streams.
> > > > >
> > > > > Lucas' significantly contributed to the state updater
> > > > > (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives
> > the
> > > > > implementation of the new threading model for Kafka Streams
> > > > > (https://issues.apache.org/jira/browse/KAFKA-15326).
> > > > >
> > > > > Lucas' contributions to KIP discussions and PR reviews are very
> > > > thoughtful.
> > > > >
> > > > > Congratulations, Lucas!
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > >
> > > >
> > >
> >
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Walker Carlson]

Congrats Lucas!

On Thu, Sep 21, 2023 at 11:42 AM Kamal Chandraprakash <
kamal.chandraprak...@gmail.com> wrote:

> Congrats Lucas!
>
> On Thu, Sep 21, 2023, 22:05 Boudjelda Mohamed Said 
> wrote:
>
> > Congratulations, Lucas!!
> >
> > On Thu 21 Sep 2023 at 18:34, Lianet M.  wrote:
> >
> > > Congratulations Lucas!
> > >
> > > On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna 
> > > wrote:
> > >
> > > > Hi all,
> > > >
> > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > > > Lucas Brutschy.
> > > >
> > > > Lucas' major contributions are around Kafka Streams.
> > > >
> > > > Lucas' significantly contributed to the state updater
> > > > (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives
> the
> > > > implementation of the new threading model for Kafka Streams
> > > > (https://issues.apache.org/jira/browse/KAFKA-15326).
> > > >
> > > > Lucas' contributions to KIP discussions and PR reviews are very
> > > thoughtful.
> > > >
> > > > Congratulations, Lucas!
> > > >
> > > > Thanks,
> > > >
> > > > Bruno (on behalf of the Apache Kafka PMC)
> > > >
> > >
> >
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Josep Prat]

Congrats Yash!

———
Josep Prat

Aiven Deutschland GmbH

Alexanderufer 3-7, 10117 Berlin

Amtsgericht Charlottenburg, HRB 209739 B

Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen

m: +491715557497

w: aiven.io

e: josep.p...@aiven.io

On Thu, Sep 21, 2023, 18:55 Raymond Ng  wrote:

> Congrats Yash! Well-deserved!
>
> /Ray
>
> On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
> kamal.chandraprak...@gmail.com> wrote:
>
> > Congratulations Yash!
> >
> > On Thu, Sep 21, 2023, 22:03 Bill Bejeck  wrote:
> >
> > > Congrats Yash!
> > >
> > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya  >
> > > wrote:
> > >
> > > > Congratulations Yash!
> > > >
> > > > Divij Vaidya
> > > >
> > > >
> > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar 
> > wrote:
> > > > >
> > > > > Congrats Yash !
> > > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin
>  > >
> > > > wrote:
> > > > >
> > > > > > Awesome ! Congratulations Yash !!
> > > > > >
> > > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> > edoardli...@gmail.com
> > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Congratulations Yash
> > > > > > >
> > > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna <
> cado...@apache.org
> > >
> > > > wrote:
> > > > > > > >
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > > > committer
> > > > > > > > Yash Mayya.
> > > > > > > >
> > > > > > > > Yash's major contributions are around Connect.
> > > > > > > >
> > > > > > > > Yash authored the following KIPs:
> > > > > > > >
> > > > > > > > KIP-793: Allow sink connectors to be used with topic-mutating
> > > SMTs
> > > > > > > > KIP-882: Kafka Connect REST API configuration validation
> > timeout
> > > > > > > > improvements
> > > > > > > > KIP-970: Deprecate and remove Connect's redundant task
> > > > configurations
> > > > > > > > endpoint
> > > > > > > > KIP-980: Allow creating connectors in a stopped state
> > > > > > > >
> > > > > > > > Overall, Yash is known for insightful and friendly input to
> > > > discussions
> > > > > > > > and his high quality contributions.
> > > > > > > >
> > > > > > > > Congratulations, Yash!
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > >
> > > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > > >
> > > > > >
> > > >
> > >
> >
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Raymond Ng]

Congrats Yash! Well-deserved!

/Ray

On Thu, Sep 21, 2023 at 9:40 AM Kamal Chandraprakash <
kamal.chandraprak...@gmail.com> wrote:

> Congratulations Yash!
>
> On Thu, Sep 21, 2023, 22:03 Bill Bejeck  wrote:
>
> > Congrats Yash!
> >
> > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya 
> > wrote:
> >
> > > Congratulations Yash!
> > >
> > > Divij Vaidya
> > >
> > >
> > > On Thu, Sep 21, 2023 at 6:18 PM Sagar 
> wrote:
> > > >
> > > > Congrats Yash !
> > > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin  >
> > > wrote:
> > > >
> > > > > Awesome ! Congratulations Yash !!
> > > > >
> > > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar <
> edoardli...@gmail.com
> > >
> > > > > wrote:
> > > > >
> > > > > > Congratulations Yash
> > > > > >
> > > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna  >
> > > wrote:
> > > > > > >
> > > > > > > Hi all,
> > > > > > >
> > > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > > committer
> > > > > > > Yash Mayya.
> > > > > > >
> > > > > > > Yash's major contributions are around Connect.
> > > > > > >
> > > > > > > Yash authored the following KIPs:
> > > > > > >
> > > > > > > KIP-793: Allow sink connectors to be used with topic-mutating
> > SMTs
> > > > > > > KIP-882: Kafka Connect REST API configuration validation
> timeout
> > > > > > > improvements
> > > > > > > KIP-970: Deprecate and remove Connect's redundant task
> > > configurations
> > > > > > > endpoint
> > > > > > > KIP-980: Allow creating connectors in a stopped state
> > > > > > >
> > > > > > > Overall, Yash is known for insightful and friendly input to
> > > discussions
> > > > > > > and his high quality contributions.
> > > > > > >
> > > > > > > Congratulations, Yash!
> > > > > > >
> > > > > > > Thanks,
> > > > > > >
> > > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > > >
> > > > >
> > >
> >
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Kamal Chandraprakash]

Congrats Lucas!

On Thu, Sep 21, 2023, 22:05 Boudjelda Mohamed Said 
wrote:

> Congratulations, Lucas!!
>
> On Thu 21 Sep 2023 at 18:34, Lianet M.  wrote:
>
> > Congratulations Lucas!
> >
> > On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna 
> > wrote:
> >
> > > Hi all,
> > >
> > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > > Lucas Brutschy.
> > >
> > > Lucas' major contributions are around Kafka Streams.
> > >
> > > Lucas' significantly contributed to the state updater
> > > (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the
> > > implementation of the new threading model for Kafka Streams
> > > (https://issues.apache.org/jira/browse/KAFKA-15326).
> > >
> > > Lucas' contributions to KIP discussions and PR reviews are very
> > thoughtful.
> > >
> > > Congratulations, Lucas!
> > >
> > > Thanks,
> > >
> > > Bruno (on behalf of the Apache Kafka PMC)
> > >
> >
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Kamal Chandraprakash]

Congratulations Yash!

On Thu, Sep 21, 2023, 22:03 Bill Bejeck  wrote:

> Congrats Yash!
>
> On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya 
> wrote:
>
> > Congratulations Yash!
> >
> > Divij Vaidya
> >
> >
> > On Thu, Sep 21, 2023 at 6:18 PM Sagar  wrote:
> > >
> > > Congrats Yash !
> > > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin 
> > wrote:
> > >
> > > > Awesome ! Congratulations Yash !!
> > > >
> > > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar  >
> > > > wrote:
> > > >
> > > > > Congratulations Yash
> > > > >
> > > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna 
> > wrote:
> > > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> > committer
> > > > > > Yash Mayya.
> > > > > >
> > > > > > Yash's major contributions are around Connect.
> > > > > >
> > > > > > Yash authored the following KIPs:
> > > > > >
> > > > > > KIP-793: Allow sink connectors to be used with topic-mutating
> SMTs
> > > > > > KIP-882: Kafka Connect REST API configuration validation timeout
> > > > > > improvements
> > > > > > KIP-970: Deprecate and remove Connect's redundant task
> > configurations
> > > > > > endpoint
> > > > > > KIP-980: Allow creating connectors in a stopped state
> > > > > >
> > > > > > Overall, Yash is known for insightful and friendly input to
> > discussions
> > > > > > and his high quality contributions.
> > > > > >
> > > > > > Congratulations, Yash!
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > > >
> > > >
> >
>

[jira] [Created] (KAFKA-15484) Implement general uniform broker side assignor

[Ritika Muduganti (Jira)]

Ritika Muduganti created KAFKA-15484:


 Summary: Implement general uniform broker side assignor
 Key: KAFKA-15484
 URL: https://issues.apache.org/jira/browse/KAFKA-15484
 Project: Kafka
  Issue Type: Sub-task
Reporter: Ritika Muduganti
Assignee: Ritika Muduganti


Part 2 of the Uniform broker side assignor for consumer groups that have 
different members subscribed to different topics



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Boudjelda Mohamed Said]

Congratulations, Lucas!!

On Thu 21 Sep 2023 at 18:34, Lianet M.  wrote:

> Congratulations Lucas!
>
> On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna 
> wrote:
>
> > Hi all,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > Lucas Brutschy.
> >
> > Lucas' major contributions are around Kafka Streams.
> >
> > Lucas' significantly contributed to the state updater
> > (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the
> > implementation of the new threading model for Kafka Streams
> > (https://issues.apache.org/jira/browse/KAFKA-15326).
> >
> > Lucas' contributions to KIP discussions and PR reviews are very
> thoughtful.
> >
> > Congratulations, Lucas!
> >
> > Thanks,
> >
> > Bruno (on behalf of the Apache Kafka PMC)
> >
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Lianet M.]

Congratulations Lucas!

On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna  wrote:

> Hi all,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Lucas Brutschy.
>
> Lucas' major contributions are around Kafka Streams.
>
> Lucas' significantly contributed to the state updater
> (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the
> implementation of the new threading model for Kafka Streams
> (https://issues.apache.org/jira/browse/KAFKA-15326).
>
> Lucas' contributions to KIP discussions and PR reviews are very thoughtful.
>
> Congratulations, Lucas!
>
> Thanks,
>
> Bruno (on behalf of the Apache Kafka PMC)
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Bill Bejeck]

Congrats Yash!

On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya 
wrote:

> Congratulations Yash!
>
> Divij Vaidya
>
>
> On Thu, Sep 21, 2023 at 6:18 PM Sagar  wrote:
> >
> > Congrats Yash !
> > On Thu, 21 Sep 2023 at 9:38 PM, Ashwin 
> wrote:
> >
> > > Awesome ! Congratulations Yash !!
> > >
> > > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar 
> > > wrote:
> > >
> > > > Congratulations Yash
> > > >
> > > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna 
> wrote:
> > > > >
> > > > > Hi all,
> > > > >
> > > > > The PMC of Apache Kafka is pleased to announce a new Kafka
> committer
> > > > > Yash Mayya.
> > > > >
> > > > > Yash's major contributions are around Connect.
> > > > >
> > > > > Yash authored the following KIPs:
> > > > >
> > > > > KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> > > > > KIP-882: Kafka Connect REST API configuration validation timeout
> > > > > improvements
> > > > > KIP-970: Deprecate and remove Connect's redundant task
> configurations
> > > > > endpoint
> > > > > KIP-980: Allow creating connectors in a stopped state
> > > > >
> > > > > Overall, Yash is known for insightful and friendly input to
> discussions
> > > > > and his high quality contributions.
> > > > >
> > > > > Congratulations, Yash!
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Bruno (on behalf of the Apache Kafka PMC)
> > > >
> > >
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Bill Bejeck]

Congrats Lucas! Well deserved.

— Bill

On Thu, Sep 21, 2023 at 12:21 PM Kirk True  wrote:

> Congratulations, Lucas!
>
> > On Sep 21, 2023, at 9:16 AM, Sagar  wrote:
> >
> > Congrats Lucas !
> >
> > On Thu, 21 Sep 2023 at 9:15 PM, Bruno Cadonna 
> wrote:
> >
> >> Hi all,
> >>
> >> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> >> Lucas Brutschy.
> >>
> >> Lucas' major contributions are around Kafka Streams.
> >>
> >> Lucas' significantly contributed to the state updater
> >> (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the
> >> implementation of the new threading model for Kafka Streams
> >> (https://issues.apache.org/jira/browse/KAFKA-15326).
> >>
> >> Lucas' contributions to KIP discussions and PR reviews are very
> thoughtful.
> >>
> >> Congratulations, Lucas!
> >>
> >> Thanks,
> >>
> >> Bruno (on behalf of the Apache Kafka PMC)
> >>
>
>

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Philip Nee]

Nice!

On Thu, Sep 21, 2023 at 9:21 AM Kirk True  wrote:

> Congratulations, Lucas!
>
> > On Sep 21, 2023, at 9:16 AM, Sagar  wrote:
> >
> > Congrats Lucas !
> >
> > On Thu, 21 Sep 2023 at 9:15 PM, Bruno Cadonna 
> wrote:
> >
> >> Hi all,
> >>
> >> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> >> Lucas Brutschy.
> >>
> >> Lucas' major contributions are around Kafka Streams.
> >>
> >> Lucas' significantly contributed to the state updater
> >> (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the
> >> implementation of the new threading model for Kafka Streams
> >> (https://issues.apache.org/jira/browse/KAFKA-15326).
> >>
> >> Lucas' contributions to KIP discussions and PR reviews are very
> thoughtful.
> >>
> >> Congratulations, Lucas!
> >>
> >> Thanks,
> >>
> >> Bruno (on behalf of the Apache Kafka PMC)
> >>
>
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Divij Vaidya]

Congratulations Yash!

Divij Vaidya


On Thu, Sep 21, 2023 at 6:18 PM Sagar  wrote:
>
> Congrats Yash !
> On Thu, 21 Sep 2023 at 9:38 PM, Ashwin  wrote:
>
> > Awesome ! Congratulations Yash !!
> >
> > On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar 
> > wrote:
> >
> > > Congratulations Yash
> > >
> > > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna  wrote:
> > > >
> > > > Hi all,
> > > >
> > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > > > Yash Mayya.
> > > >
> > > > Yash's major contributions are around Connect.
> > > >
> > > > Yash authored the following KIPs:
> > > >
> > > > KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> > > > KIP-882: Kafka Connect REST API configuration validation timeout
> > > > improvements
> > > > KIP-970: Deprecate and remove Connect's redundant task configurations
> > > > endpoint
> > > > KIP-980: Allow creating connectors in a stopped state
> > > >
> > > > Overall, Yash is known for insightful and friendly input to discussions
> > > > and his high quality contributions.
> > > >
> > > > Congratulations, Yash!
> > > >
> > > > Thanks,
> > > >
> > > > Bruno (on behalf of the Apache Kafka PMC)
> > >
> >

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Kirk True]

Congratulations, Lucas!

> On Sep 21, 2023, at 9:16 AM, Sagar  wrote:
> 
> Congrats Lucas !
> 
> On Thu, 21 Sep 2023 at 9:15 PM, Bruno Cadonna  wrote:
> 
>> Hi all,
>> 
>> The PMC of Apache Kafka is pleased to announce a new Kafka committer
>> Lucas Brutschy.
>> 
>> Lucas' major contributions are around Kafka Streams.
>> 
>> Lucas' significantly contributed to the state updater
>> (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the
>> implementation of the new threading model for Kafka Streams
>> (https://issues.apache.org/jira/browse/KAFKA-15326).
>> 
>> Lucas' contributions to KIP discussions and PR reviews are very thoughtful.
>> 
>> Congratulations, Lucas!
>> 
>> Thanks,
>> 
>> Bruno (on behalf of the Apache Kafka PMC)
>> 

Re: [ANNOUNCE] New committer: Lucas Brutschy

[Sagar]

Congrats Lucas !

On Thu, 21 Sep 2023 at 9:15 PM, Bruno Cadonna  wrote:

> Hi all,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Lucas Brutschy.
>
> Lucas' major contributions are around Kafka Streams.
>
> Lucas' significantly contributed to the state updater
> (https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the
> implementation of the new threading model for Kafka Streams
> (https://issues.apache.org/jira/browse/KAFKA-15326).
>
> Lucas' contributions to KIP discussions and PR reviews are very thoughtful.
>
> Congratulations, Lucas!
>
> Thanks,
>
> Bruno (on behalf of the Apache Kafka PMC)
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Sagar]

Congrats Yash !
On Thu, 21 Sep 2023 at 9:38 PM, Ashwin  wrote:

> Awesome ! Congratulations Yash !!
>
> On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar 
> wrote:
>
> > Congratulations Yash
> >
> > On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna  wrote:
> > >
> > > Hi all,
> > >
> > > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > > Yash Mayya.
> > >
> > > Yash's major contributions are around Connect.
> > >
> > > Yash authored the following KIPs:
> > >
> > > KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> > > KIP-882: Kafka Connect REST API configuration validation timeout
> > > improvements
> > > KIP-970: Deprecate and remove Connect's redundant task configurations
> > > endpoint
> > > KIP-980: Allow creating connectors in a stopped state
> > >
> > > Overall, Yash is known for insightful and friendly input to discussions
> > > and his high quality contributions.
> > >
> > > Congratulations, Yash!
> > >
> > > Thanks,
> > >
> > > Bruno (on behalf of the Apache Kafka PMC)
> >
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Ashwin]

Awesome ! Congratulations Yash !!

On Thu, Sep 21, 2023 at 9:25 PM Edoardo Comar  wrote:

> Congratulations Yash
>
> On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna  wrote:
> >
> > Hi all,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > Yash Mayya.
> >
> > Yash's major contributions are around Connect.
> >
> > Yash authored the following KIPs:
> >
> > KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> > KIP-882: Kafka Connect REST API configuration validation timeout
> > improvements
> > KIP-970: Deprecate and remove Connect's redundant task configurations
> > endpoint
> > KIP-980: Allow creating connectors in a stopped state
> >
> > Overall, Yash is known for insightful and friendly input to discussions
> > and his high quality contributions.
> >
> > Congratulations, Yash!
> >
> > Thanks,
> >
> > Bruno (on behalf of the Apache Kafka PMC)
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Edoardo Comar]

Congratulations Yash

On Thu, 21 Sept 2023 at 16:28, Bruno Cadonna  wrote:
>
> Hi all,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Yash Mayya.
>
> Yash's major contributions are around Connect.
>
> Yash authored the following KIPs:
>
> KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> KIP-882: Kafka Connect REST API configuration validation timeout
> improvements
> KIP-970: Deprecate and remove Connect's redundant task configurations
> endpoint
> KIP-980: Allow creating connectors in a stopped state
>
> Overall, Yash is known for insightful and friendly input to discussions
> and his high quality contributions.
>
> Congratulations, Yash!
>
> Thanks,
>
> Bruno (on behalf of the Apache Kafka PMC)

Re: [ANNOUNCE] New committer: Yash Mayya

[Greg Harris]

Congratulations Yash!
Glad to have you :)

On Thu, Sep 21, 2023 at 8:44 AM Boudjelda Mohamed Said
 wrote:
>
> Congratulations Yash Mayya
>
>
> On Thu 21 Sep 2023 at 17:28, Bruno Cadonna  wrote:
>
> > Hi all,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > Yash Mayya.
> >
> > Yash's major contributions are around Connect.
> >
> > Yash authored the following KIPs:
> >
> > KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> > KIP-882: Kafka Connect REST API configuration validation timeout
> > improvements
> > KIP-970: Deprecate and remove Connect's redundant task configurations
> > endpoint
> > KIP-980: Allow creating connectors in a stopped state
> >
> > Overall, Yash is known for insightful and friendly input to discussions
> > and his high quality contributions.
> >
> > Congratulations, Yash!
> >
> > Thanks,
> >
> > Bruno (on behalf of the Apache Kafka PMC)
> >

[ANNOUNCE] New committer: Lucas Brutschy

[Bruno Cadonna]

Hi all,

The PMC of Apache Kafka is pleased to announce a new Kafka committer 
Lucas Brutschy.


Lucas' major contributions are around Kafka Streams.

Lucas' significantly contributed to the state updater 
(https://issues.apache.org/jira/browse/KAFKA-10199) and he drives the 
implementation of the new threading model for Kafka Streams 
(https://issues.apache.org/jira/browse/KAFKA-15326).


Lucas' contributions to KIP discussions and PR reviews are very thoughtful.

Congratulations, Lucas!

Thanks,

Bruno (on behalf of the Apache Kafka PMC)

Re: [ANNOUNCE] New committer: Yash Mayya

[Boudjelda Mohamed Said]

Congratulations Yash Mayya


On Thu 21 Sep 2023 at 17:28, Bruno Cadonna  wrote:

> Hi all,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Yash Mayya.
>
> Yash's major contributions are around Connect.
>
> Yash authored the following KIPs:
>
> KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> KIP-882: Kafka Connect REST API configuration validation timeout
> improvements
> KIP-970: Deprecate and remove Connect's redundant task configurations
> endpoint
> KIP-980: Allow creating connectors in a stopped state
>
> Overall, Yash is known for insightful and friendly input to discussions
> and his high quality contributions.
>
> Congratulations, Yash!
>
> Thanks,
>
> Bruno (on behalf of the Apache Kafka PMC)
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Nikhil Srivastava]

Congratulations Yash !!

On Thu, 21 Sept 2023 at 21:03, Chris Egerton 
wrote:

> Congratulations Yash, well-deserved!
>
> On Thu, Sep 21, 2023, 11:28 Bruno Cadonna  wrote:
>
> > Hi all,
> >
> > The PMC of Apache Kafka is pleased to announce a new Kafka committer
> > Yash Mayya.
> >
> > Yash's major contributions are around Connect.
> >
> > Yash authored the following KIPs:
> >
> > KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> > KIP-882: Kafka Connect REST API configuration validation timeout
> > improvements
> > KIP-970: Deprecate and remove Connect's redundant task configurations
> > endpoint
> > KIP-980: Allow creating connectors in a stopped state
> >
> > Overall, Yash is known for insightful and friendly input to discussions
> > and his high quality contributions.
> >
> > Congratulations, Yash!
> >
> > Thanks,
> >
> > Bruno (on behalf of the Apache Kafka PMC)
> >
>

Re: [ANNOUNCE] New committer: Yash Mayya

[Chris Egerton]

Congratulations Yash, well-deserved!

On Thu, Sep 21, 2023, 11:28 Bruno Cadonna  wrote:

> Hi all,
>
> The PMC of Apache Kafka is pleased to announce a new Kafka committer
> Yash Mayya.
>
> Yash's major contributions are around Connect.
>
> Yash authored the following KIPs:
>
> KIP-793: Allow sink connectors to be used with topic-mutating SMTs
> KIP-882: Kafka Connect REST API configuration validation timeout
> improvements
> KIP-970: Deprecate and remove Connect's redundant task configurations
> endpoint
> KIP-980: Allow creating connectors in a stopped state
>
> Overall, Yash is known for insightful and friendly input to discussions
> and his high quality contributions.
>
> Congratulations, Yash!
>
> Thanks,
>
> Bruno (on behalf of the Apache Kafka PMC)
>

[ANNOUNCE] New committer: Yash Mayya

[Bruno Cadonna]

Hi all,

The PMC of Apache Kafka is pleased to announce a new Kafka committer 
Yash Mayya.


Yash's major contributions are around Connect.

Yash authored the following KIPs:

KIP-793: Allow sink connectors to be used with topic-mutating SMTs
KIP-882: Kafka Connect REST API configuration validation timeout 
improvements
KIP-970: Deprecate and remove Connect's redundant task configurations 
endpoint

KIP-980: Allow creating connectors in a stopped state

Overall, Yash is known for insightful and friendly input to discussions 
and his high quality contributions.


Congratulations, Yash!

Thanks,

Bruno (on behalf of the Apache Kafka PMC)

[jira] [Resolved] (KAFKA-14960) Metadata Request Manager and listTopics/partitionsFor API

[Jun Rao (Jira)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jun Rao resolved KAFKA-14960.
-
Fix Version/s: 3.7.0
   Resolution: Fixed

merged the PR to trunk.

> Metadata Request Manager and listTopics/partitionsFor API
> -
>
> Key: KAFKA-14960
> URL: https://issues.apache.org/jira/browse/KAFKA-14960
> Project: Kafka
>  Issue Type: Task
>  Components: clients, consumer
>Reporter: Philip Nee
>Assignee: Philip Nee
>Priority: Major
>  Labels: consumer-threading-refactor
> Fix For: 3.7.0
>
>
> Implement listTopics and partitionsFor



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Re: [DISCUSS] KIP-714: Client metrics and observability

[Andrew Schofield]

Hi Jun,
Thanks for your comments. I’ve updated the KIP to clarify where necessary.

110. Yes, agree. The motivation section mentions this.

111. The replacement of ‘-‘ with ‘.’ for metric names and the replacement of
‘-‘ with ‘_’ for attribute keys is following the OTLP guidelines. I think it’s 
a bit
of a debatable point. OTLP makes a distinction between a namespace and a
multi-word component. If it was “client.id” then “client” would be a namespace 
with
an attribute key “id”. But “client_id” is just a key. So, it was intentional, 
but debatable.

112. Thanks. The link target moved. Fixed.

113. Thanks. Fixed.

114.1. If a standard metric makes sense for a client, it should use the exact 
same
name. If a standard metric doesn’t make sense for a client, then it can omit 
that metric.

For a required metric, the situation is stronger. All clients must implement 
these
metrics with these names in order to implement the KIP. But the required metrics
are essentially the number of connections and the request latency, which do not
reference the underlying implementation of the client (which 
producer.record.queue.time.max
of course does).

I suppose someone might build a producer-only client that didn’t have consumer 
metrics.
In this case, the consumer metrics would conceptually have the value 0 and 
would not
need to be sent to the broker.

114.2. If a client does not implement some metrics, they will not be available 
for
analysis and troubleshooting. It just makes the ability to combine metrics from 
lots
different clients less complete.

115. I think it was probably a mistake to be so specific about threading in 
this KIP.
When the consumer threading refactor is complete, of course, it would do the 
appropriate
equivalent. I’ve added a clarification and massively simplified this section.

116. I removed “client.terminating”.

117. Yes. Horrid. Fixed.

118. The Terminating flag just indicates that this is the final 
PushTelemetryRequest
from this client. Any subsequent request will be rejected. I think this flag 
should remain.

119. Good catch. This was actually contradicting another part of the KIP. The 
current behaviour
is indeed preserved. If the broker doesn’t have a client metrics receiver 
plugin, the new RPCs
in this KIP are “turned off” and not reported in ApiVersionsResponse. The 
client will not
attempt to push metrics.

120. The error handling table lists the error codes for PushTelemetryResponse. 
I’ve added one
but it looked good to me. GetTelemetrySubscriptions doesn’t have any error 
codes, since the
situation in which the client telemetry is not supported is handled by the RPCs 
not being offered
by the broker.

121. Again, I think it’s probably a mistake to be specific about threading. 
Removed.

122. Good catch. For DescribeConfigs, the ACL operation should be
“DESCRIBE_CONFIGS”. For AlterConfigs, the ACL operation should be
“ALTER” (not “WRITE” as it said). The checks are made on the CLUSTER
resource.

Thanks for the detailed review.

Thanks,
Andrew

>
> 110. Another potential motivation is the multiple clients support. Some of
> the places may not have good monitoring support for non-java clients.
>
> 111. OpenTelemetry Naming: We replace '-' with '.' for metric name and
> replace '-' with '_' for attributes. Why is the inconsistency?
>
> 112. OTLP specification: Page is not found from the link.
>
> 113. "Defining standard and required metrics makes the monitoring and
> troubleshooting of clients from various client types ": Incomplete sentence.
>
> 114. standard/required metrics
> 114.1 Do other clients need to implement those metrics with the exact same
> names?
> 114.2 What happens if some of those metrics are missing from a client?
>
> 115. "KafkaConsumer: both the "heart beat" and application threads": We
> have an ongoing effort to refactor the consumer threading model (
> https://cwiki.apache.org/confluence/display/KAFKA/Consumer+threading+refactor+design).
> Once this is done, PRC requests will only be made from the background
> thread. Should this KIP follow the new model only?
>
> 116. 'The metrics should contain the reason for the client termination by
> including the client.terminating metric with the label “reason” ...'. Hmm,
> are we introducing a new metric client.terminating? If so, that needs to be
> explicitly listed.
>
> 117. "As the metrics plugin may need to add additional metrics on top of
> this the generic metrics receiver in the broker will not add these labels
> but rely on the plugins to do so," The sentence doesn't read well.
>
> 118. "it is possible for the client to send at most one accepted
> out-of-profile per connection before the rate-limiter kicks in": If we do
> this, do we still need the Terminating flag in PushTelemetryRequestV0?
>
> 119. "If there is no client metrics receiver plugin configured on the
> broker, it will respond to GetTelemetrySubscriptionsRequest with
> RequestedMetrics set to Null and a -1 SubscriptionId. The client should
> send 

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2220

[Apache Jenkins Server]

See 

[GitHub] [kafka-site] mumrah opened a new pull request, #548: MINOR Add KIP-938 metrics to ops.html

[via GitHub]

mumrah opened a new pull request, #548:
URL: https://github.com/apache/kafka-site/pull/548

   (no comment)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #61

[Apache Jenkins Server]

See 

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2219

[Apache Jenkins Server]

See 

Re: [kafka-clients] [VOTE] 3.6.0 RC1

[Josep Prat]

Hi Satish,

I ran the following validation steps:
- Built from source with Java 11 and Scala 2.13
- Verified Signatures and hashes of the artifacts generated
- Navigated through Javadoc including links to JDK classes
- Run the unit tests
- Run integration tests
- Run the quickstart in KRaft and Zookeeper mode


I +1 this release (non-binding)

Thanks for your efforts!

On Thu, Sep 21, 2023 at 2:59 AM Satish Duggana 
wrote:

> Thanks Greg for verifying the release including the earlier
> blocker(KAFKA-15473) verification.
>
> ~Satish.
>
> On Wed, 20 Sept 2023 at 22:30, Greg Harris 
> wrote:
>
> > Hi all,
> >
> > I verified the functionality of KIP-898 and the recent fix for
> > KAFKA-15473 with the following steps:
> >
> > 1. I started a 3.5.1 broker, and a 3.5.1 worker with most (>400)
> > publicly available plugins installed
> > 2. I captured the output of /connector-plugins
> > 3. I upgraded the worker to 3.6.0-rc1
> > 4. I captured the output of /connector-plugins with various settings
> > of plugin.discovery
> > 5. I ran the migration script to add manifests to my plugins
> > 6. I captured the output of /connector-plugins with various settings
> > of plugin.discovery
> > 7. I downgraded the worker to 3.5.1
> > 8. I diffed the output of /connector-plugins across the different
> > cases and observed the expected changes.
> > a. When plugins are migrated for 3.6.0, all modes produce identical
> > results.
> > b. When plugins are not migrated for 3.6.0, only_scan and
> > hybrid_warn produce identical results, hybrid_fail crashes, and
> > service_load is missing plugins
> > c. When upgrading from 3.5.1 I see that plugins with invalid
> > constructors are hidden, AK plugins now have versions, multi-interface
> > plugins now show each interface type, and plugins using AppInfoParser
> > change versions.
> > d. The startup logs now include descriptive errors for invalid
> > plugins that otherwise would have been thrown at runtime
> > d. The fix for KAFKA-15473 prevents duplicates
> > e. The output for 3.5.1 after downgrading is identical to before.
> >
> > +1 (non-binding)
> >
> > Thanks Satish for running the release!
> >
> > On Wed, Sep 20, 2023 at 8:36 AM Divij Vaidya  wrote:
> > >
> > > Hey Satish
> > >
> > > My comments about documentation misses from RC0 vote thread [1] are
> > > still not addressed (such as missing metric documentation, formatting
> > > problems etc). Could you please mention why we shouldn't consider them
> > > as blockers to make RC1 as the final release?
> > >
> > > [1] https://lists.apache.org/thread/cokoxzd0jtgjtrlxoq7kkzmvpm75381t
> > >
> > > On Wed, Sep 20, 2023 at 4:53 PM Satish Duggana <
> satish.dugg...@gmail.com>
> > wrote:
> > > >
> > > > Hello Kafka users, developers and client-developers,
> > > >
> > > > This is the second candidate for the release of Apache Kafka 3.6.0.
> > Some of the major features include:
> > > >
> > > > * KIP-405 : Kafka Tiered Storage
> > > > * KIP-868 : KRaft Metadata Transactions
> > > > * KIP-875: First-class offsets support in Kafka Connect
> > > > * KIP-898: Modernize Connect plugin discovery
> > > > * KIP-938: Add more metrics for measuring KRaft performance
> > > > * KIP-902: Upgrade Zookeeper to 3.8.1
> > > > * KIP-917: Additional custom metadata for remote log segment
> > > >
> > > > Release notes for the 3.6.0 release:
> > > > https://home.apache.org/~satishd/kafka-3.6.0-rc1/RELEASE_NOTES.html
> > > >
> > > > *** Please download, test and vote by Saturday, September 23, 8am PT
> > > >
> > > > Kafka's KEYS file containing PGP keys we use to sign the release:
> > > > https://kafka.apache.org/KEYS
> > > >
> > > > * Release artifacts to be voted upon (source and binary):
> > > > https://home.apache.org/~satishd/kafka-3.6.0-rc1/
> > > >
> > > > * Maven artifacts to be voted upon:
> > > >
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
> > > >
> > > > * Javadoc:
> > > > https://home.apache.org/~satishd/kafka-3.6.0-rc1/javadoc/
> > > >
> > > > * Tag to be voted upon (off 3.6 branch) is the 3.6.0 tag:
> > > > https://github.com/apache/kafka/releases/tag/3.6.0-rc1
> > > >
> > > > * Documentation:
> > > > https://kafka.apache.org/36/documentation.html
> > > >
> > > > * Protocol:
> > > > https://kafka.apache.org/36/protocol.html
> > > >
> > > > * Successful Jenkins builds for the 3.6 branch:
> > > > There are a few runs of unit/integration tests. You can see the
> latest
> > at https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.6/. We will
> > continue running a few more iterations.
> > > > System tests:
> > > > We will send an update once we have the results.
> > > >
> > > > Thanks,
> > > > Satish.
> > > >
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups "kafka-clients" group.
> > > > To unsubscribe from this group and stop receiving emails from it,
> send
> > an email to kafka-clients+unsubscr...@googlegroups.com.
> > > > To view this discussion on 

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #60

[Apache Jenkins Server]

See 

Re: [DISCUSS] KIP-980: Allow creating connectors in a stopped state

[Yash Mayya]

Hi Ashwin,

Thanks for taking a look and sharing your thoughts!

1. Yes, the request / response formats of the two APIs were intentionally
made identical for such use-cases. [1]

2. I'm assuming you're referring to retaining the offset / config topic
records for a connector when it is deleted by a user? Firstly, a
connector's offsets aren't actually currently deleted when the connector is
deleted - it was listed as potential future work in KIP-875 [2]. Secondly,
the config topic is the source of truth for the state of a Connect cluster
and a connector deletion is done by writing a null-valued record
(tombstone) with the connector key to the config topic. We could
potentially modify the delete mechanism to use a special new record
(instead of a tombstone with the connector key) in order to retain the
latest configuration of a connector while still deleting the actual
connector - however, this would have its downsides and I don't see too many
benefits. Furthermore, connector migration between different Kafka clusters
was just used as a representational use case for creating connectors in a
stopped state - it isn't the primary focus of this KIP as such.

3. KIP-875 goes into some more details about this [3], but the TLDR is that
the STOPPED state will be treated like the PAUSED state on older workers
that don't recognize the STOPPED state.

Thanks,
Yash

[1] -
https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect#KIP875:FirstclassoffsetssupportinKafkaConnect-Request/responseformat

[2] -
https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect#KIP875:FirstclassoffsetssupportinKafkaConnect-Automaticallydeleteoffsetswithconnectors

[3] -
https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect#KIP875:FirstclassoffsetssupportinKafkaConnect-STOPPEDtargetstate

On Wed, Sep 20, 2023 at 7:24 PM Ashwin  wrote:

> Thanks Yash! This is very useful for migrating connectors from one cluster
> to another.
>
> I had the following comments/questions
>
> 1. Is the offset read using `GET /offsets` api always guaranteed to be in a
> format accepted by `PATCH /offsets` ?
> 2. I had to tackle a similar migration situation but the two connect
> clusters in question were using the same backing Kafka cluster. The
> challenge in this case is that when I delete the original connector, I want
> to retain offsets and config topics. Do you think we should support
> deletion of a connector without removal of these topics as part of this KIP
> ?
> 3. In the case of a downgrade, how will Connect worker handle the optional
> “state” field in config topic ?
>
> Thanks,
> Ashwin
>
>
>
>
> On Sun, Sep 17, 2023 at 11:09 PM Yash Mayya  wrote:
>
> > Hi all,
> >
> > I'd like to begin discussion on a KIP to allow creating connectors in a
> > stopped state -
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-980%3A+Allow+creating+connectors+in+a+stopped+state
> >
> >
> > Thanks,
> > Yash
> >
>

Re: Apache Kafka 3.6.0 release

[Divij Vaidya]

Hey Satish

I filed a PR to fix the website formatting bug in 3.6 documentation -
https://github.com/apache/kafka/pull/14419
Please take a look when you get a chance.

--
Divij Vaidya

On Tue, Sep 19, 2023 at 5:36 PM Chris Egerton  wrote:
>
> Hi Satish,
>
> I think this qualifies as a blocker. This API has been around for years now
> and, while we don't document it as not exposing duplicates*, it has come
> with that implicit contract since its inception. More importantly, it has
> also never exposed plugins that cannot be used on the worker. This change
> in behavior not only introduces duplicates*, it causes unreachable plugins
> to be displayed. With this in mind, it seems to qualify pretty clearly as a
> regression and we should not put out a release that includes it.
>
> * - Really, these aren't duplicates; rather, they're multiple copies of the
> same plugin that come from different locations on the worker
>
> Best,
>
> Chris
>
> On Tue, Sep 19, 2023 at 4:31 AM Satish Duggana 
> wrote:
>
> > Hi Greg,
> > Is this API documented that it does not return duplicate entries?
> >
> > Can we also get an opinion from PMC/Committers who have KafkaConnect
> > expertise on whether this issue is a release blocker?
> >
> > If we agree that it is not a release blocker then we can have a
> > release note clarifying this behaviour and add a reference to the JIRA
> > that follows up on the possible solutions.
> >
> > Thanks,
> > Satish.
> >
> >
> > On Tue, 19 Sept 2023 at 03:29, Greg Harris 
> > wrote:
> > >
> > > Hey Satish,
> > >
> > > After investigating further, I believe that this is a regression, but
> > > mostly a cosmetic one.
> > > I don't think there is significant risk of breaking clients with this
> > > change, but it would be confusing for users, so I'd still like to get
> > > the fix into the next RC.
> > > I've opened a PR here: https://github.com/apache/kafka/pull/14398 and
> > > I'll work to get it merged promptly.
> > >
> > > Thanks!
> > >
> > > On Mon, Sep 18, 2023 at 11:54 AM Greg Harris 
> > wrote:
> > > >
> > > > Hi Satish,
> > > >
> > > > While validating 3.6.0-rc0, I noticed this regression as compared to
> > > > 3.5.1: https://issues.apache.org/jira/browse/KAFKA-15473
> > > >
> > > > Impact: The `connector-plugins` endpoint lists duplicates which may
> > > > cause confusion for users, or poor behavior in clients.
> > > > Using the other REST API endpoints appears unaffected.
> > > > I'll open a PR for this later today.
> > > >
> > > > Thanks,
> > > > Greg
> > > >
> > > > On Thu, Sep 14, 2023 at 11:56 AM Satish Duggana
> > > >  wrote:
> > > > >
> > > > > Thanks Justine for the update. I saw in the morning that these
> > changes
> > > > > are pushed to trunk and 3.6.
> > > > >
> > > > > ~Satish.
> > > > >
> > > > > On Thu, 14 Sept 2023 at 21:54, Justine Olshan
> > > > >  wrote:
> > > > > >
> > > > > > Hi Satish,
> > > > > > We were able to merge
> > > > > > https://issues.apache.org/jira/browse/KAFKA-15459 yesterday
> > > > > > and pick to 3.6.
> > > > > >
> > > > > > Hopefully nothing more from me on this release.
> > > > > >
> > > > > > Thanks,
> > > > > > Justine
> > > > > >
> > > > > > On Wed, Sep 13, 2023 at 9:51 PM Satish Duggana <
> > satish.dugg...@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Thanks Luke for the update.
> > > > > > >
> > > > > > > ~Satish.
> > > > > > >
> > > > > > > On Thu, 14 Sept 2023 at 07:29, Luke Chen 
> > wrote:
> > > > > > > >
> > > > > > > > Hi Satish,
> > > > > > > >
> > > > > > > > Since this PR:
> > > > > > > > https://github.com/apache/kafka/pull/14366 only changes the
> > doc, I've
> > > > > > > > backported to 3.6 branch. FYI.
> > > > > > > >
> > > > > > > > Thanks.
> > > > > > > > Luke
> > > > > > > >
> > > > > > > > On Thu, Sep 14, 2023 at 12:15 AM Justine Olshan
> > > > > > > >  wrote:
> > > > > > > >
> > > > > > > > > Hey Satish -- yes, you are correct. KAFKA-15459 only affects
> > 3.6.
> > > > > > > > > PR should be finalized soon.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Justine
> > > > > > > > >
> > > > > > > > > On Wed, Sep 13, 2023 at 1:41 AM Federico Valeri <
> > fedeval...@gmail.com>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi Satish, this is a small documentation fix about ZK to
> > KRaft
> > > > > > > > > > migration, that we would like to backport to 3.5 and 3.6
> > branches.
> > > > > > > Are
> > > > > > > > > > you ok with that?
> > > > > > > > > >
> > > > > > > > > > https://github.com/apache/kafka/pull/14366
> > > > > > > > > >
> > > > > > > > > > On Wed, Sep 13, 2023 at 3:13 AM Satish Duggana <
> > > > > > > satish.dugg...@gmail.com
> > > > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > Thanks David for the quick resolution.
> > > > > > > > > > >
> > > > > > > > > > > ~Satish.
> > > > > > > > > > >
> > > > > > > > > > > On Tue, 12 Sept 2023 at 22:51, David Arthur
> > > > > > > > > > >  wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > Satish,

[jira] [Reopened] (KAFKA-15463) StreamsException: Accessing from an unknown node

[Yevgeny (Jira)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yevgeny reopened KAFKA-15463:
-

Re openning

issue reproduced

topics definition (other topics similar):


input_topic PartitionCount: 3 ReplicationFactor: 1 Configs: 
min.insync.replicas=1,cleanup.policy=delete,segment.bytes=10485760,retention.ms=-1,message.format.version=2.6-IV0,file.delete.delay.ms=1000,max.message.bytes=1,retention.bytes=10485760,segment.ms=2160
Topic: input_topicPartition: 0Leader: 0Replicas: 0Isr: 0
Topic: input_topicPartition: 1Leader: 1Replicas: 1Isr: 1
Topic: input_topicPartition: 2Leader: 2Replicas: 2Isr: 2

inside the Transformer, I am doing

{{}}
{code:java}
void process(MyItem myItem){
   KeyValueStore store =   
context.getStateStore("storeName"); //fails here

}{code}
{{{}{}}}the supplier:

(spring bean prototype)

{{}}
{code:java}
private final MYService myServiceBean;
@Override
public void init(ProcessorContext context) {
    myServiceBean.setContext(context);
}

@Override
public KeyValue transform(String key, MyItem myItem) {
    myServiceBean.process(myItem);
}{code}
{{}}

>  StreamsException: Accessing from an unknown node
> -
>
> Key: KAFKA-15463
> URL: https://issues.apache.org/jira/browse/KAFKA-15463
> Project: Kafka
>  Issue Type: Bug
>  Components: streams
>Affects Versions: 3.2.1
>Reporter: Yevgeny
>Priority: Major
>
> After some time application was working fine, starting to get:
>  
> This is springboot application runs in kubernetes as stateful pod.
>  
>  
>  
> {code:java}
>   Exception in thread 
> "-ddf9819f-d6c7-46ce-930e-cd923e1b3c2c-StreamThread-1" 
> org.apache.kafka.streams.errors.StreamsException: Accessing from an unknown 
> node at 
> org.apache.kafka.streams.processor.internals.ProcessorContextImpl.getStateStore(ProcessorContextImpl.java:162)
>  at myclass1.java:28) at myclass2.java:48) at 
> java.base/java.util.stream.MatchOps$1MatchSink.accept(MatchOps.java:90) at 
> java.base/java.util.ArrayList$ArrayListSpliterator.tryAdvance(ArrayList.java:1602)
>  at 
> java.base/java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129)
>  at 
> java.base/java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527)
>  at 
> java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513)
>  at 
> java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
>  at 
> java.base/java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:230)
>  at 
> java.base/java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:196)
>  at 
> java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
>  at 
> java.base/java.util.stream.ReferencePipeline.allMatch(ReferencePipeline.java:637)
>  at myclass3.java:48) at 
> org.apache.kafka.streams.kstream.internals.TransformerSupplierAdapter$1.transform(TransformerSupplierAdapter.java:49)
>  at 
> org.apache.kafka.streams.kstream.internals.TransformerSupplierAdapter$1.transform(TransformerSupplierAdapter.java:38)
>  at 
> org.apache.kafka.streams.kstream.internals.KStreamFlatTransform$KStreamFlatTransformProcessor.process(KStreamFlatTransform.java:66)
>  at 
> org.apache.kafka.streams.processor.internals.ProcessorNode.process(ProcessorNode.java:146)
>  at 
> org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forwardInternal(ProcessorContextImpl.java:275)
>  at 
> org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:254)
>  at 
> org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:213)
>  at 
> org.apache.kafka.streams.processor.internals.SourceNode.process(SourceNode.java:84)
>  at 
> org.apache.kafka.streams.processor.internals.StreamTask.lambda$doProcess$1(StreamTask.java:780)
>  at 
> org.apache.kafka.streams.processor.internals.metrics.StreamsMetricsImpl.maybeMeasureLatency(StreamsMetricsImpl.java:809)
>  at 
> org.apache.kafka.streams.processor.internals.StreamTask.doProcess(StreamTask.java:780)
>  at 
> org.apache.kafka.streams.processor.internals.StreamTask.process(StreamTask.java:711)
>  at 
> org.apache.kafka.streams.processor.internals.TaskExecutor.processTask(TaskExecutor.java:100)
>  at 
> org.apache.kafka.streams.processor.internals.TaskExecutor.process(TaskExecutor.java:81)
>  at 
> org.apache.kafka.streams.processor.internals.TaskManager.process(TaskManager.java:1177)
>  at 
> org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:769)
>  at 
> org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:589)
>  at 
> org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:551)
>    {code}
>  
> 

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.6 #59

[Apache Jenkins Server]

See 

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2218

[Apache Jenkins Server]

See