Re: Propose a KIP to report "REAL" broker/consumer fetch latency?

2021-07-27 Thread Kai Huang
Hi Ming, I will be interested in the proposed capability to diagnose Kafka latency issues and continue the discussion. Do you mind if I take over this discussion thread and follow up with the community? On 2021/04/25 17:33:10, Ming Liu wrote: > The idea I am trying right now is: > 1. Add

Re: Request Permission to Contribute to Apache Kafka

2021-07-27 Thread Matthias J. Sax
There are three wiki accounts with the name "Kai Huang" -- I added the one with id `kaihuang`. Let us know if it was the wrong one. -Matthias On 7/27/21 12:15 PM, Kai Huang wrote: > To whom it may concern, > > Hi, I'd like to request permission to contribute to Apache Kafka by > following

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

2021-07-27 Thread Konstantine Karantasis
Thanks Ryan and Ron for reporting these new issues. KAFKA-13142 is approved as an issue with no good workaround (and keeping in mind that we have a few open blockers still) and KAFKA-13137 is approved as a blocker because it's a regression. Konstantine On Tue, Jul 27, 2021 at 5:22 PM Ron

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

2021-07-27 Thread Ron Dagostino
Hi Konstantine. I've opened KAFKA-13137 as a potential blocker. An approved PR is available at https://github.com/apache/kafka/pull/11131. The kafka.controller metrics that the KRaft controllers expose have the wrong MBean names. Ron > On Jul 27, 2021, at 8:13 PM, Ryan Dielhenn > wrote: > >

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

2021-07-27 Thread Ryan Dielhenn
Hello, I would like to report a bug in KRaft. Dynamic broker configs are not being validated on the brokers before being forwarded to the controller and persisted in the metadata quorum. This is a blocker because a core requirement of KRaft mode in 3.0 is that it should support upgrades from

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.0 #66

2021-07-27 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-13139) Empty response after requesting to restart a connector without the tasks results in NPE

2021-07-27 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-13139. Resolution: Fixed > Empty response after requesting to restart a

[jira] [Created] (KAFKA-13143) Disable Metadata endpoint for KRaft controller

2021-07-27 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-13143: --- Summary: Disable Metadata endpoint for KRaft controller Key: KAFKA-13143 URL: https://issues.apache.org/jira/browse/KAFKA-13143 Project: Kafka Issue

[jira] [Created] (KAFKA-13142) KRaft controller does not validate dynamic configs

2021-07-27 Thread Ryan Dielhenn (Jira)
Ryan Dielhenn created KAFKA-13142: - Summary: KRaft controller does not validate dynamic configs Key: KAFKA-13142 URL: https://issues.apache.org/jira/browse/KAFKA-13142 Project: Kafka Issue

Request Permission to Contribute to Apache Kafka

2021-07-27 Thread Kai Huang
To whom it may concern, Hi, I'd like to request permission to contribute to Apache Kafka by following instructions here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals My wiki ID: Kai Huang My Jira ID: kaihuang Can someone help grant the permission for me? Your

[jira] [Created] (KAFKA-13141) Leader should not update follower fetch offset if diverging epoch is present

2021-07-27 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-13141: --- Summary: Leader should not update follower fetch offset if diverging epoch is present Key: KAFKA-13141 URL: https://issues.apache.org/jira/browse/KAFKA-13141

Re: [VOTE] KIP-761: Add Total Blocked Time Metric to Streams

2021-07-27 Thread Guozhang Wang
Hello Rohan, Thanks for the KIP. As Bruno mentioned in the other thread could you update the "New Metrics" that 1) we have sub-titles for streams, producer, consumer metrics, just for clarification, and 2) update the "producer-id" etc to "client-id" to be consistent with the existing metrics.

Re: [VOTE] KIP-763: Range queries with open endpoints

2021-07-27 Thread Guozhang Wang
Thank you, Patrick! The KIP looks good to me, and I also agree with the pragmatic manner. +1 (binding) Guozhang On Thu, Jul 22, 2021 at 11:09 AM John Roesler wrote: > Thank you, Patrick, > > +1 (binding) from me as well! > > Thanks, > -John > > On Thu, 2021-07-22 at 10:40 +0200, Bruno

[jira] [Created] (KAFKA-13140) KRaft brokers do not expose kafka.controller metrics, breaking backwards compatibility

2021-07-27 Thread Ron Dagostino (Jira)
Ron Dagostino created KAFKA-13140: - Summary: KRaft brokers do not expose kafka.controller metrics, breaking backwards compatibility Key: KAFKA-13140 URL: https://issues.apache.org/jira/browse/KAFKA-13140

Re: [VOTE] KIP-745: Connect API to restart connector and tasks

2021-07-27 Thread Randall Hauch
FYI, we found a minor error in KIP-745 [1] where it described the old behavior of the connector restart API as returning a "200 OK" response, instead of the "204 NO CONTENT" response actually returned by this API in AK 2.8 and earlier. See KAFKA-13139 [2] for the issue where this was discovered

Re: [VOTE] KIP-690: Add additional configuration to control MirrorMaker 2 internal topics naming convention

2021-07-27 Thread Josep Prat
Thanks for the KIP! +1 (non-binding) from my side! On Tue, Jul 27, 2021 at 2:22 PM lobo xu wrote: > +1,I think that's a good idea. When we use MirrorMaker2, we do not want > subject name conversion to occur. Hopefully there is a switch that can be > configured. > > > 在 2021年7月27日,06:38,Omnia

Re: [VOTE] KIP-690: Add additional configuration to control MirrorMaker 2 internal topics naming convention

2021-07-27 Thread lobo xu
+1,I think that's a good idea. When we use MirrorMaker2, we do not want subject name conversion to occur. Hopefully there is a switch that can be configured. > 在 2021年7月27日,06:38,Omnia Ibrahim 写道: > > Bumping up this voting thread.

Re: [DISCUSS] KIP-761: Add total blocked time metric to streams

2021-07-27 Thread Sophie Blee-Goldman
Thanks for the clarifications, that all makes sense. I'm ready to vote on the KIP, but can you just update the KIP first to address Bruno's feedback? Ie just fix the tags and fill in the missing fields. For example it sounds like these would be thread-level metrics. You should be able to figure