Re: [ANNOUNCE] New committer: Lucas Bradstreet

2023-02-16 Thread Tom Bentley
Congratulations! On Fri, 17 Feb 2023 at 05:26, Yash Mayya wrote: > Congratulations Lucas! > > On Fri, Feb 17, 2023 at 3:25 AM Jun Rao wrote: > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > Lucas > > Bradstreet. > > > > Lucas has been a long

Re: Requesting permissions to contribute to Apache Kafka.

2023-02-16 Thread Luke Chen
Hi Jakub, Your wiki account is all set. Thank you. Luke On Fri, Feb 17, 2023 at 4:23 AM Jakub Miroś wrote: > Hello Everyone :) > > According to this guide: > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals > Could you give me permissions to contribute to Apache

Re: [DISCUSS] KIP-641 An new java interface to replace 'kafka.common.MessageReader'

2023-02-16 Thread Luke Chen
Hi Chia-Ping, Thanks for the KIP! Overall LGTM, just one minor comment: Could we log warning messages to users when using deprecated MessageReader? Thank you. Luke On Fri, Feb 17, 2023 at 2:04 PM Chia-Ping Tsai wrote: > hi Bentley > > I have updated the KIP to make RecordReader extend

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1594

2023-02-16 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-641 An new java interface to replace 'kafka.common.MessageReader'

2023-02-16 Thread Chia-Ping Tsai
hi Bentley I have updated the KIP to make RecordReader extend Configurable. PTAL

Re: [ANNOUNCE] New committer: Lucas Bradstreet

2023-02-16 Thread Yash Mayya
Congratulations Lucas! On Fri, Feb 17, 2023 at 3:25 AM Jun Rao wrote: > Hi, Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Lucas > Bradstreet. > > Lucas has been a long time Kafka contributor since Oct. 2018. He has been > extremely valuable for Kafka on both

[jira] [Created] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread RivenSun (Jira)
RivenSun created KAFKA-14729: Summary: The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread Key: KAFKA-14729 URL:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1593

2023-02-16 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #85

2023-02-16 Thread Apache Jenkins Server
See

Re: [ANNOUNCE] New committer: Lucas Bradstreet

2023-02-16 Thread John Roesler
Congratulations, Lucas! -John On Thu, Feb 16, 2023, at 19:52, Luke Chen wrote: > Congratulations, Lucas! > > Luke > > On Fri, Feb 17, 2023 at 8:57 AM Guozhang Wang > wrote: > >> Congratulations, Lucas! >> >> On Thu, Feb 16, 2023 at 3:18 PM Kowshik Prakasam >> wrote: >> > >> > Congratulations,

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #155

2023-02-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 501003 lines...] [2023-02-17T01:54:04.719Z] [2023-02-17T01:54:04.719Z] DeleteRecordsRequestTest >

Re: [ANNOUNCE] New committer: Lucas Bradstreet

2023-02-16 Thread Luke Chen
Congratulations, Lucas! Luke On Fri, Feb 17, 2023 at 8:57 AM Guozhang Wang wrote: > Congratulations, Lucas! > > On Thu, Feb 16, 2023 at 3:18 PM Kowshik Prakasam > wrote: > > > > Congratulations, Lucas! > > > > > > Cheers, > > Kowshik > > > > On Thu, Feb 16, 2023, 2:07 PM Justine Olshan > > >

[jira] [Resolved] (KAFKA-14253) StreamsPartitionAssignor should print the member count in assignment logs

2023-02-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-14253. --- Fix Version/s: 3.5.0 Resolution: Fixed > StreamsPartitionAssignor should print the

Re: [ANNOUNCE] New committer: Lucas Bradstreet

2023-02-16 Thread Guozhang Wang
Congratulations, Lucas! On Thu, Feb 16, 2023 at 3:18 PM Kowshik Prakasam wrote: > > Congratulations, Lucas! > > > Cheers, > Kowshik > > On Thu, Feb 16, 2023, 2:07 PM Justine Olshan > wrote: > > > Congratulations Lucas! > > > > Thanks for your mentorship on some of my KIPs as well :) > > > > On

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1592

2023-02-16 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-14727) Connect EOS mode should periodically call task commit

2023-02-16 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14727. --- Fix Version/s: 3.5.0 Resolution: Fixed > Connect EOS mode should periodically call

Re: [ANNOUNCE] New committer: Lucas Bradstreet

2023-02-16 Thread Kowshik Prakasam
Congratulations, Lucas! Cheers, Kowshik On Thu, Feb 16, 2023, 2:07 PM Justine Olshan wrote: > Congratulations Lucas! > > Thanks for your mentorship on some of my KIPs as well :) > > On Thu, Feb 16, 2023 at 1:56 PM Jun Rao wrote: > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased

Re: [ANNOUNCE] New committer: Lucas Bradstreet

2023-02-16 Thread Justine Olshan
Congratulations Lucas! Thanks for your mentorship on some of my KIPs as well :) On Thu, Feb 16, 2023 at 1:56 PM Jun Rao wrote: > Hi, Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Lucas > Bradstreet. > > Lucas has been a long time Kafka contributor since

[ANNOUNCE] New committer: Lucas Bradstreet

2023-02-16 Thread Jun Rao
Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer Lucas Bradstreet. Lucas has been a long time Kafka contributor since Oct. 2018. He has been extremely valuable for Kafka on both performance and correctness improvements. The following are his performance related

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #84

2023-02-16 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1591

2023-02-16 Thread Apache Jenkins Server
See

Requesting permissions to contribute to Apache Kafka.

2023-02-16 Thread Jakub Miroś
Hello Everyone :) According to this guide: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals Could you give me permissions to contribute to Apache Kafka, please? WikiID: spacrocketos JiraID: SpacRocket ( I already have permissions, adding just in case ) Thanks, Jakub

Re: [DISCUSS] KIP-898: Modernize Connect plugin discovery

2023-02-16 Thread Greg Harris
Hey Tom, Thank you for your comments! 1. I have updated the language in the KIP and added relevant links. 2. The `plugin.path.discovery` name was intended to communicate that it controlled the interpretation of the `plugin.path` configuration, but I can see how that can be confusing. I suppose

[jira] [Resolved] (KAFKA-14565) Interceptor Resource Leak

2023-02-16 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14565. --- Resolution: Fixed > Interceptor Resource Leak > - > >

[jira] [Created] (KAFKA-14728) Remove 'spotlessScalaCheck' task (out of Jenkinsfile)

2023-02-16 Thread Jira
Dejan Stojadinović created KAFKA-14728: -- Summary: Remove 'spotlessScalaCheck' task (out of Jenkinsfile) Key: KAFKA-14728 URL: https://issues.apache.org/jira/browse/KAFKA-14728 Project: Kafka

Re: [DISCUSS] KIP-899: Allow clients to rebootstrap

2023-02-16 Thread Chris Egerton
Hi Ivan, I'm not very familiar with the clients side of things but the proposal seems reasonable. I like the flexibility of the "metadata.recovery.strategy" property as a string instead of, e.g., a "rebootstrap.enabled" boolean. We may want to adapt a different approach in the future, like the

[jira] [Created] (KAFKA-14727) Connect EOS mode should periodically call task commit

2023-02-16 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14727: --- Summary: Connect EOS mode should periodically call task commit Key: KAFKA-14727 URL: https://issues.apache.org/jira/browse/KAFKA-14727 Project: Kafka Issue

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1590

2023-02-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 532838 lines...] [2023-02-16T16:30:58.274Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 178 > UpdateFeaturesTest >

Re: [DISCUSS] KIP-641 An new java interface to replace 'kafka.common.MessageReader'

2023-02-16 Thread Chia-Ping Tsai
> 3. On the matter of configure(): While it doesn't add any functionality, it > would be more consistent with other plugins if this interface extended > Configurable, and the InputStream was then passed via some other method > (`readFrom(InputStream)` perhaps). If nothing else it would make it

Re: [DISCUSS] KIP-641 An new java interface to replace 'kafka.common.MessageReader'

2023-02-16 Thread Chia-Ping Tsai
On 2023/02/16 11:26:04 Federico Valeri wrote: > Hi Chia-Ping, thanks for updating the KIP. > > I would only add that we plan to remove the old trait in the next > major release. I think it's better to be explicit about this. sure. I have added this description to doc about deprecation.

Re: [DISCUSS] KIP-641 An new java interface to replace 'kafka.common.MessageReader'

2023-02-16 Thread Tom Bentley
Hi Chia-Ping, Thanks for the KIP. I have just a few minor comments: 1. The Javadoc for the new interface says "an `InputStream` received via `init`" but the interface doesn't have an init() method. I guess you meant configure()? 2. The Javadoc should mention the need for implementations to have

[VOTE] KIP-900: KRaft kafka-storage.sh API additions to support SCRAM for Kafka Brokers

2023-02-16 Thread Proven Provenzano
Hi, I'd like to start the vote on KIP-900: KRaft kafka-storage.sh API additions to support SCRAM for Kafka Brokers. The KIP is here: KIP-900 The Original

Re: Kafka design docs

2023-02-16 Thread Arun Raju
Thank you, Like. On Wed, Feb 15, 2023, 10:33 PM Luke Chen wrote: > Hi Arun, > > The official doc should be good enough: > https://kafka.apache.org/documentation/#design > For detailed design doc, you can check the Kafka Improvement Proposals: > >

Re: [DISCUSS] KIP-898: Modernize Connect plugin discovery

2023-02-16 Thread Tom Bentley
Hi Greg, Thanks for the KIP. Overall I think using service loading would be a worthwhile improvement. 1. "Both of these are well-established Java interfaces for which public documentation should be readily available." I see no harm in adding a well chosen link or two just to save readers

Re: [DISCUSS] KIP-641 An new java interface to replace 'kafka.common.MessageReader'

2023-02-16 Thread Federico Valeri
Hi Chia-Ping, thanks for updating the KIP. I would only add that we plan to remove the old trait in the next major release. I think it's better to be explicit about this. On Thu, Feb 16, 2023 at 11:34 AM Chia-Ping Tsai wrote: > > Dear all, > > I have updated the KIP to address comments. PTAL >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #83

2023-02-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 435462 lines...] [2023-02-16T06:03:47.485Z] [2023-02-16T06:03:47.485Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 172 >

Re: [DISCUSS] KIP-641 An new java interface to replace 'kafka.common.MessageReader'

2023-02-16 Thread Chia-Ping Tsai
Dear all, I have updated the KIP to address comments. PTAL https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866569

Re: [DISCUSS] KIP-906 Tools migration guidelines

2023-02-16 Thread Federico Valeri
On Thu, Feb 16, 2023 at 10:26 AM Luke Chen wrote: > > Hi Federico, > > 1. Sounds good. > I think you should make it clear in the KIP. > > We only have one tool with this issue (kafka.tools.StateChangeLogMerger), > which is tracked in KAFKA-7735 >

[jira] [Resolved] (KAFKA-14621) Don't startup in migration mode if an authorizer is enabled

2023-02-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14621. --- Fix Version/s: 3.4.0 Resolution: Done Close this since this is completed in kafka v3.4.0  

Doubt regarding Kafka Authentication / Authorization

2023-02-16 Thread Viram Shah
Hi Team, I have tried multiple ways but couldn't figure out the exact solution to a problem I am looking for dynamic user management / access control / new user addition in Kafka so that we can manage our cluster. For e.g. whenever a new topic gets created, I want to add a new principal /

Re: [DISCUSS] KIP-906 Tools migration guidelines

2023-02-16 Thread Luke Chen
Hi Federico, 1. Sounds good. I think you should make it clear in the KIP. We only have one tool with this issue (kafka.tools.StateChangeLogMerger), which is tracked in KAFKA-7735 . This has been broken since 2.0 release, so it means that there is

Re: [DISCUSS] KIP-906 Tools migration guidelines

2023-02-16 Thread Federico Valeri
Hi Luke, thanks for the feedback. On Thu, Feb 16, 2023 at 9:33 AM Luke Chen wrote: > > Hi Federico, > > Thanks for the KIP. > It's really helpful to have a general guideline for tools migration so that > contributors and reviewers can be clear what to be expected. > > One question: > In the

Re: [DISCUSS] KIP-906 Tools migration guidelines

2023-02-16 Thread Luke Chen
Hi Federico, Thanks for the KIP. It's really helpful to have a general guideline for tools migration so that contributors and reviewers can be clear what to be expected. One question: In the broker link tool, you said we should directly deprecate it. But does that mean this tool will keep

Re: [DISCUSS] KIP-906 Tools migration guidelines

2023-02-16 Thread Federico Valeri
Sorry for the spam. I had some issue with my mail client. On Wed, Feb 15, 2023 at 3:42 PM Federico Valeri wrote: > > Hi everyone, > > I opened KIP-906 to have some guidelines around tools migration: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-906%3A+Tools+migration+guidelines > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1589

2023-02-16 Thread Apache Jenkins Server
See