Need permission to contribute to Apache Kafka

2023-06-08 Thread Gaurav Badoni
Hi, I am a Confluent employee and want to start contributing to Apache Kafka. Can you please give me the required access Here are my details: wiki ID: gauravbadoni Jira ID: gbadoni email: gauravbad...@gmail.com. Thanks Gaurav

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1911

2023-06-08 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

2023-06-08 Thread David Arthur
Ok, thanks for the explanations. +1 binding from me -David On Thu, Jun 8, 2023 at 6:08 PM Colin McCabe wrote: > One note. I added ForwardingManager queue metrics. This should be the last > addition! > > best, > Colin > > On Thu, Jun 8, 2023, at 14:47, Colin McCabe wrote: > > On Thu, Jun 8,

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1910

2023-06-08 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

2023-06-08 Thread Colin McCabe
One note. I added ForwardingManager queue metrics. This should be the last addition! best, Colin On Thu, Jun 8, 2023, at 14:47, Colin McCabe wrote: > On Thu, Jun 8, 2023, at 10:00, David Arthur wrote: >> Colin, thanks for the KIP! These all seem like pretty useful additions. A >> few quick

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

2023-06-08 Thread Colin McCabe
On Thu, Jun 8, 2023, at 10:00, David Arthur wrote: > Colin, thanks for the KIP! These all seem like pretty useful additions. A > few quick questions > > 1) Will the value of TimedOutBrokerHeartbeatCount be zero for inactive > controllers? No. It will just stay at whatever it was when the

[jira] [Resolved] (KAFKA-14966) Extract reusable common logic from OffsetFetcher

2023-06-08 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14966. - Fix Version/s: 3.6.0 Resolution: Fixed Merged the PR to trunk. > Extract reusable common logic

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1909

2023-06-08 Thread Apache Jenkins Server
See Changes: -- [...truncated 575355 lines...] [2023-06-08T18:40:58.764Z] [2023-06-08T18:40:58.764Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 179

Re: [DISCUSS] Partial CI builds - Reducing flakiness with fewer tests

2023-06-08 Thread Greg Harris
Gaurav, The target-determinator is certainly the "off-the-shelf" solution I expected would be out there. If the project migrates to Bazel I think that would make the partial builds much easier to implement. I think we should look into the other benefits of migrating to bazel to see if it is worth

Re: [DISCUSS] Conventional commits

2023-06-08 Thread Chris Egerton
Hi Ismael, I haven't worked on too many projects with conventional commits before, so forgive my ignorance. Could you share some of the advantages of this style of commit message over the existing style? Cheers, Chris On Thu, Jun 8, 2023 at 12:34 PM Ismael Juma wrote: > Hi Josep and Bruno, >

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

2023-06-08 Thread David Arthur
Colin, thanks for the KIP! These all seem like pretty useful additions. A few quick questions 1) Will the value of TimedOutBrokerHeartbeatCount be zero for inactive controllers? Will the value reset to zero after an election, or only process restart? 2) Does HandleLoadSnapshotCount include the

Re: [DISCUSS] Conventional commits

2023-06-08 Thread Ismael Juma
Hi Josep and Bruno, Thanks for the initial feedback, these are good questions. Let's give it a few days for others to chime in. If there is general consensus that this is worth pursuing, my thinking is that we'll need to find a volunteer to capture the specifics of how we would use this approach

[GitHub] [kafka-site] C0urante merged pull request #520: KAFKA-15051: add missing GET plugin/config endpoint

2023-06-08 Thread via GitHub
C0urante merged PR #520: URL: https://github.com/apache/kafka-site/pull/520 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [DISCUSS] KIP-936: Throttle number of active PIDs

2023-06-08 Thread Claude Warren
The link I thought I included did not carry over in the last post. The paper can be found at: https://webdocs.cs.ualberta.ca/~drafiei/papers/DupDet06Sigmod.pdf On Thu, Jun 8, 2023 at 9:05 AM Claude Warren wrote: > > Have you considered using Stable Bloom Filters [1]. I think they do what >

Re: [DISCUSS] KIP-936: Throttle number of active PIDs

2023-06-08 Thread Claude Warren
Have you considered using Stable Bloom Filters [1]. I think they do what you want without a lot of the overhead you propose for your solution. In addition, you may want to look at Commons-Collections v4.5 [2] (currently snapshot) for efficient Bloom filter code. I have a Stable Bloom

Re: [DISCUSS] Conventional commits

2023-06-08 Thread Bruno Cadonna
Hi Ismael, Thanks for bringing this up! In general, I am in favor of more structured commits. Even better if the conventional commits specification favors to split commits into smaller commits by concern as described in the FAQs. Additionally to Josep's questions, I have the following

Re: [DISCUSS] Conventional commits

2023-06-08 Thread Josep Prat
Hi Ismael, Thanks for raising this topic Ismael, I like the idea, I think this would bring some more meaningful first-liners on the commits. I guess we could use the scope (what comes within parentheses) to indicate the module the commit refers to (if it's single module) However, I doubt if this

[DISCUSS] Conventional commits

2023-06-08 Thread Ismael Juma
Hi, A number of open source projects have adopted the conventional commits specification. What do people think about using this for Apache Kafka? https://www.conventionalcommits.org/en/v1.0.0/ Thanks, Ismael