Re: [DISCUSS] KIP-761: Add total blocked time metric to streams

2021-07-21 Thread Rohan Desai
> I remember now that we moved the round-trip PID's txn completion logic into init-transaction and commit/abort-transaction. So I think we'd count time as in StreamsProducer#initTransaction as well (admittedly it is in most cases a one-time thing). Makes sense - I'll update the KIP On Tue, Jul

Re: [DISCUSS] KIP-761: Add total blocked time metric to streams

2021-07-21 Thread Rohan Desai
> I had a question - it seems like from the descriptionsof `txn-commit-time-total` and `offset-commit-time-total` that they measure similar processes for ALOS and EOS, but only `txn-commit-time-total` is included in `blocked-time-total`. Why isn't `offset-commit-time-total` also included? I've

Jenkins build became unstable: Kafka » Kafka Branch Builder » 3.0 #52

2021-07-21 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-763: Range queries with open endpoints

2021-07-21 Thread Bruno Cadonna
Thanks for the KIP, Patrick! I agree with John that your KIP is well motivated. I have just one minor feedback. Could you add store.range(null, null) to the example snippets with the comment that this is equivalent to all() (it is equivalent, right?)? This question about equivalence between

Re: [DISCUSS] KIP-763: Range queries with open endpoints

2021-07-21 Thread Patrick Stuedi
Thanks John, Bruno for the valuable feedback! John: I had a quick look at the SessionStore and WindowStore interface. While it looks like we should be able to apply similar ideas to those stores, the actual interfaces are slightly different and expanding them for open ranges may need a bit more

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #346

2021-07-21 Thread Apache Jenkins Server
See Changes: -- [...truncated 486136 lines...] [2021-07-21T09:10:27.032Z] org.apache.kafka.streams.integration.KStreamTransformIntegrationTest >

[jira] [Created] (KAFKA-13115) doSend can be blocking

2021-07-21 Thread Ivan Vaskevych (Jira)
Ivan Vaskevych created KAFKA-13115: -- Summary: doSend can be blocking Key: KAFKA-13115 URL: https://issues.apache.org/jira/browse/KAFKA-13115 Project: Kafka Issue Type: Bug

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.0 #53

2021-07-21 Thread Apache Jenkins Server
See

permission request

2021-07-21 Thread mohamed amine belkhodja
Hi, I'm interested to contribute on the kafka project, here my IDs wiki: ae84fb5e7a3a25da017ac90bfbce0240 jira user name: belkhodja.amine *Bien cordialement / Best regards* Mohamed Amine Belkhodja, Mobile: +(33) 06.26.61.95.48 email: belkhodja.am...@gmail.com

[jira] [Created] (KAFKA-13116) Adjust system tests due to KAFKA-12944

2021-07-21 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-13116: --- Summary: Adjust system tests due to KAFKA-12944 Key: KAFKA-13116 URL: https://issues.apache.org/jira/browse/KAFKA-13116 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-12418) Make sure it's ok not to include test jars in the release tarball

2021-07-21 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-12418. - Resolution: Done > Make sure it's ok not to include test jars in the release tarball >

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #347

2021-07-21 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-13117) After processors, migrate TupleForwarder and CacheFlushListener

2021-07-21 Thread John Roesler (Jira)
John Roesler created KAFKA-13117: Summary: After processors, migrate TupleForwarder and CacheFlushListener Key: KAFKA-13117 URL: https://issues.apache.org/jira/browse/KAFKA-13117 Project: Kafka

[jira] [Resolved] (KAFKA-10546) KIP-478: Deprecate the old PAPI interfaces

2021-07-21 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-10546. -- Resolution: Fixed > KIP-478: Deprecate the old PAPI interfaces >

subscription

2021-07-21 Thread mohamed amine belkhodja
Hi, I'm interested to contribute on the kafka project *Bien cordialement / Best regards* Mohamed Amine Belkhodja, Mobile: +(33) 06.26.61.95.48 email: belkhodja.am...@gmail.com

[jira] [Created] (KAFKA-13119) Validate the KRaft controllerListener config on startup

2021-07-21 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-13119: Summary: Validate the KRaft controllerListener config on startup Key: KAFKA-13119 URL: https://issues.apache.org/jira/browse/KAFKA-13119 Project: Kafka

[jira] [Resolved] (KAFKA-13119) Validate the KRaft controllerListener config on startup

2021-07-21 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13119. -- Resolution: Fixed > Validate the KRaft controllerListener config on startup >

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

2021-07-21 Thread Colin McCabe
Hi Konstantine, Thanks for your work on this release! We discovered three blocker bugs which are worth bringing up here: 1. KAFKA-13112: Controller's committed offset get out of sync with raft client listener context 2. KAFKA-13095: TransactionsTest is failing in kraft mode 3. KAFKA-12851:

[jira] [Created] (KAFKA-13121) Flaky Test TopicBasedRemoteLogMetadataManagerTest.testNewPartitionUpdates()

2021-07-21 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-13121: -- Summary: Flaky Test TopicBasedRemoteLogMetadataManagerTest.testNewPartitionUpdates() Key: KAFKA-13121 URL: https://issues.apache.org/jira/browse/KAFKA-13121

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #52

2021-07-21 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #349

2021-07-21 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-13104) Controller should notify the RaftClient when it resigns

2021-07-21 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13104. -- Resolution: Fixed Fixed > Controller should notify the RaftClient when it resigns >

Jenkins build is back to stable : Kafka » Kafka Branch Builder » 3.0 #54

2021-07-21 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #348

2021-07-21 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-13120) Flesh out `streams_static_membership_test` to be more robust

2021-07-21 Thread Leah Thomas (Jira)
Leah Thomas created KAFKA-13120: --- Summary: Flesh out `streams_static_membership_test` to be more robust Key: KAFKA-13120 URL: https://issues.apache.org/jira/browse/KAFKA-13120 Project: Kafka

[VOTE] KIP-763: Range queries with open endpoints

2021-07-21 Thread Patrick Stuedi
Hi all, Thanks for the feedback on the KIP, I have updated the KIP and would like to start the voting. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-763%3A+Range+queries+with+open+endpoints Please vote in this thread. Thanks! -Patrick

Jenkins build is unstable: Kafka » Kafka Branch Builder » 2.8 #51

2021-07-21 Thread Apache Jenkins Server
See

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

2021-07-21 Thread Konstantine Karantasis
Thanks for the heads up Colin. KAFKA-13112 seems important and of course relevant to what we ship with 3.0. Same for the test failures captured by KAFKA-13095 and KAFKA-12851. Fixing those will increase the stability of our builds. Therefore, considering these tickets as blockers currently makes

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.0 #56

2021-07-21 Thread Apache Jenkins Server
See Changes: -- [...truncated 420842 lines...] [2021-07-22T00:32:40.015Z] > Task :connect:file:testClasses [2021-07-22T00:32:40.340Z] Recording test results

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #53

2021-07-21 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-763: Range queries with open endpoints

2021-07-21 Thread Luke Chen
Hi Patrick, I like this KIP! +1 (non-binding) Luke On Thu, Jul 22, 2021 at 7:04 AM Matthias J. Sax wrote: > Thanks for the KIP. > > +1 (binding) > > > -Matthias > > On 7/21/21 1:18 PM, Patrick Stuedi wrote: > > Hi all, > > > > Thanks for the feedback on the KIP, I have updated the KIP and

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.0 #57

2021-07-21 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #350

2021-07-21 Thread Apache Jenkins Server
See Changes: -- [...truncated 486474 lines...] [2021-07-21T22:23:24.883Z] [2021-07-21T22:23:24.883Z] See

[VOTE] KIP-761: Add Total Blocked Time Metric to Streams

2021-07-21 Thread Rohan Desai
Now that the discussion thread's been open for a few days, I'm calling for a vote on https://cwiki.apache.org/confluence/display/KAFKA/KIP-761%3A+Add+Total+Blocked+Time+Metric+to+Streams

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2021-07-21 Thread Colin McCabe
Agreed. Flexible fields are the way to go here, I think. Thanks for the discussion, all. best, Colin On Tue, Jul 20, 2021, at 07:18, Ismael Juma wrote: > Hi Ron, > > Thanks for bringing this up. Thinking about it, the combination of flexible > fields and the principal type field gives us

Re: [DISCUSS] KIP-714: Client metrics and observability

2021-07-21 Thread Colin McCabe
On Tue, Jun 29, 2021, at 07:22, Magnus Edenhill wrote: > Den tors 17 juni 2021 kl 00:52 skrev Colin McCabe : > > A few critiques: > > > > - As I wrote above, I think this could benefit a lot by being split into > > several RPCs. A registration RPC, a report RPC, and an unregister RPC seem > > like

Re: [VOTE] KIP-763: Range queries with open endpoints

2021-07-21 Thread Matthias J. Sax
Thanks for the KIP. +1 (binding) -Matthias On 7/21/21 1:18 PM, Patrick Stuedi wrote: > Hi all, > > Thanks for the feedback on the KIP, I have updated the KIP and would like > to start the voting. > > The KIP can be found here: >

Re: Request permission for KIP creation

2021-07-21 Thread Haruki Okada
Hi Bill. Thank you for your quick response! 2021年7月22日(木) 7:40 Bill Bejeck : > Hi Haruki, > > You're all set with the wiki permissions now. > > Regards, > Bill > > On Wed, Jul 21, 2021 at 1:43 PM Haruki Okada wrote: > > > Hi, Kafka. > > > > I would like to request permission for KIP creation

Re: [VOTE] KIP-746: Revise KRaft Metadata Records

2021-07-21 Thread Colin McCabe
Hi all, I made an addendum to this KIP to reflect some of the changes we did recently. Specifically, we decided that since we are not supporting KRaft upgrade from 2.8 to 3.0, we should keep the message versions at 0 and increment the frame version instead. best, Colin On Thu, Jun 10, 2021,

Re: permission request

2021-07-21 Thread Bill Bejeck
Hi Mohamed, You're all set for Jira now, but I couldn't find you on the wiki. Can you confirm the wiki id? Thanks for your interest in Apache Kafka. -Bill On Wed, Jul 21, 2021 at 8:57 AM mohamed amine belkhodja < belkhodja.am...@gmail.com> wrote: > Hi, > > I'm interested to contribute on the

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #352

2021-07-21 Thread Apache Jenkins Server
See Changes: -- [...truncated 485971 lines...] [2021-07-22T02:51:40.139Z] DeleteOffsetsConsumerGroupCommandIntegrationTest >

Jenkins build became unstable: Kafka » Kafka Branch Builder » 3.0 #55

2021-07-21 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #351

2021-07-21 Thread Apache Jenkins Server
See Changes: -- [...truncated 486265 lines...] [2021-07-22T00:37:00.931Z] [2021-07-22T00:37:00.931Z] DeleteOffsetsConsumerGroupCommandIntegrationTest >

Re: [DISCUSS] KIP-761: Add total blocked time metric to streams

2021-07-21 Thread Sophie Blee-Goldman
Hey Rohan, The current metrics proposed in the KIP all LGTM, but if the goal is to include *all* time spent blocking on any client API then there are a few that might need to be added to this list. For example Consumer#committed is called in StreamTask to get the offsets during initialization,

Re: Request permission for KIP creation

2021-07-21 Thread Bill Bejeck
Hi Haruki, You're all set with the wiki permissions now. Regards, Bill On Wed, Jul 21, 2021 at 1:43 PM Haruki Okada wrote: > Hi, Kafka. > > I would like to request permission for KIP creation under > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals > to propose

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #167

2021-07-21 Thread Apache Jenkins Server
See Changes: [Randall Hauch] KAFKA-9887 fix failed task or connector count on startup failure (#8844) -- [...truncated 3.45 MB...]

[jira] [Created] (KAFKA-13118) Backport KAFKA-9887 to 3.0 branch after 3.0.0 release

2021-07-21 Thread Randall Hauch (Jira)
Randall Hauch created KAFKA-13118: - Summary: Backport KAFKA-9887 to 3.0 branch after 3.0.0 release Key: KAFKA-13118 URL: https://issues.apache.org/jira/browse/KAFKA-13118 Project: Kafka

Request permission for KIP creation

2021-07-21 Thread Haruki Okada
Hi, Kafka. I would like to request permission for KIP creation under https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals to propose a config-addition related to https://issues.apache.org/jira/browse/KAFKA-9648 . JIRA id: ocadaruma email: ocadar...@gmail.com Thanks,