Re: [VOTE] KIP-770: Replace "buffered.records.per.partition" with "input.buffer.max.bytes"

2022-02-11 Thread Sagar
Hi All, There's another amendment proposed for this KIP. We are adding a new metric type called *cache-size-bytes-total *to capture the cache size in bytes accumulated by a task. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=186878390 Thanks! Sagar. On Mon, Jan 24, 2022 at

Re: [DISCUSS] KIP-812: Introduce another form of the `KafkaStreams.close()` API that forces the member to leave the consumer group

2022-02-11 Thread Seung-chan Ahn
(re-sending with the better syntax of quotation) Hello Guozhang, Thanks for your rich comment! I'd carefully read through all you mentioned. I updated the `Public Interfaces` section of KIP and this is what I think: @Guozhang: Today we use the timeout to try to tackle all three cases, but >

Re: [DISCUSS] KIP-812: Introduce another form of the `KafkaStreams.close()` API that forces the member to leave the consumer group

2022-02-11 Thread Seung-chan Ahn
Hello Guozhang, Thanks for your rich comment! I'd carefully read through all you mentioned. I updated the `Public Interfaces` section of KIP and this is what I think: > @Guozhang: Today we use the timeout to try to tackle all three cases, but ideally we want the client to submit extra

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #686

2022-02-11 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #685

2022-02-11 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.1 #77

2022-02-11 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #684

2022-02-11 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-816: Topology changes without local state reset

2022-02-11 Thread Guozhang Wang
Just to follow-up on this thread, I had another chat with John regarding option a) and I think the key thought is that, today the task-id is in the form of [sub-topologyID]-[partitionID] --- and in the future with named-topology it could be extended to three digits as

[jira] [Resolved] (KAFKA-13661) KRaft uses the wrong permission for adding topic partitions

2022-02-11 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-13661. - Resolution: Fixed > KRaft uses the wrong permission for adding topic partitions >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #683

2022-02-11 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-634: Complementary support for headers in Kafka Streams DSL

2022-02-11 Thread Jorge Esteban Quilcate Otoya
John and team, The following changes have been applied to the KIP following your feedback: - Leverage `Record` instead of introducing a new type (`RecordValue`). - `RecordSerde` for stateful operations using `Record` as value. - Extend `Record` to: - Implement `RecordMetadata` to expose

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #682

2022-02-11 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2022-02-11 Thread John Roesler
Thanks, Julien! I’m +1 (binding) -John On Fri, Feb 11, 2022, at 08:42, Dongjin Lee wrote: > +1 (non-binding) > > Thanks for the KIP! > > Thanks, > Dongjin > > On Fri, Feb 11, 2022, 10:16 PM Julien Chanaud > wrote: > >> Bumping this vote. >> >> We have 2 binding votes so far. >> >> The

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-02-11 Thread John Roesler
+1 (binding) Thanks, John On Fri, Feb 11, 2022, at 08:43, Dongjin Lee wrote: > +1 (non-binding) > > Thanks, > Dongjin > > On Wed, Feb 9, 2022, 2:07 AM Mickael Maison > wrote: > >> Bumping this vote. >> >> We have 1 binding and 4 non-binding votes so far. >> Let me know if you have any feedback.

[jira] [Resolved] (KAFKA-12256) auto commit causes delays due to retriable UNKNOWN_TOPIC_OR_PARTITION

2022-02-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12256. --- Fix Version/s: 3.2.0 Resolution: Fixed > auto commit causes delays due to retriable

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #681

2022-02-11 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-13577) Replace EasyMock and PowerMock with Mockito in core module

2022-02-11 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13577. Fix Version/s: 3.2.0 Resolution: Fixed > Replace EasyMock and PowerMock with

Re: [DISCUSS] KIP-820: Extend KStream process with new Processor API

2022-02-11 Thread John Roesler
Thanks, Jorge! I think it’ll be better to keep this KIP focused on KStream methods only. I suspect that the KTable methods may be more complicated than just that proposed replacement, but it’ll also be easier to consider that question in isolation. The nice thing about just deprecating the

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-02-11 Thread Dongjin Lee
+1 (non-binding) Thanks, Dongjin On Wed, Feb 9, 2022, 2:07 AM Mickael Maison wrote: > Bumping this vote. > > We have 1 binding and 4 non-binding votes so far. > Let me know if you have any feedback. > > Thanks, > Mickael > > On Wed, Feb 2, 2022 at 10:13 AM Julien Chanaud > wrote: > > > > Hi

Re: [VOTE] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2022-02-11 Thread Dongjin Lee
+1 (non-binding) Thanks for the KIP! Thanks, Dongjin On Fri, Feb 11, 2022, 10:16 PM Julien Chanaud wrote: > Bumping this vote. > > We have 2 binding votes so far. > > The associated PR is already implemented: > https://github.com/apache/kafka/pull/11575 > Let me know if you have any feedback.

Re: [VOTE] KIP-815: Replace KafkaConsumer with AdminClient in GetOffsetShell

2022-02-11 Thread deng ziming
David, Thank you for pointing out this. After some time, I sorted out the main configurations, the main difference are default.api.timeout.ms , retries, request.timeout.ms ,metadata.max.age.ms . Please

Re: [VOTE] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2022-02-11 Thread Julien Chanaud
Bumping this vote. We have 2 binding votes so far. The associated PR is already implemented: https://github.com/apache/kafka/pull/11575 Let me know if you have any feedback. Thanks, Julien PS: Have a look at the KIP-769 voting thread as well :) Le mer. 26 janv. 2022 à 12:46, Mickael Maison a

[jira] [Resolved] (KAFKA-12251) Add topic ID support to StopReplica

2022-02-11 Thread dengziming (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dengziming resolved KAFKA-12251. Resolution: Won't Do > Add topic ID support to StopReplica > ---

Re: [DISCUSS] KIP-820: Extend KStream process with new Processor API

2022-02-11 Thread Jorge Esteban Quilcate Otoya
Thanks, John. > 4) I agree that we shouldn't deprecate the Transformer* classes, but do you think we should deprecate the KStream#transform* methods? I'm curious if there's any remaining reason to have those methods, or if your KIP completely obviates them. Good catch. I considered that

Re: [VOTE] KIP-797: Accept duplicate listener on port for IPv4/IPv6

2022-02-11 Thread Luke Chen
Hi Matthew, Thanks for the update. I'm +1 (binding) Thank you. Luke On Fri, Feb 11, 2022 at 3:32 PM Matthew de Detrich wrote: > Hi Luke, > > I have just updated the KIP with the changes you requested. > > Regards > > On Fri, Feb 11, 2022 at 4:47 AM Luke Chen wrote: > > > Hi Matthew, > > > >