Re: [DISCUSS] KIP-761: Add total blocked time metric to streams

2021-07-12 Thread Guozhang Wang
Hey Rohan, Thanks for putting up the KIP. Maybe you can also briefly talk about the context in the email message as well (they are very well explained inside the KIP doc though). I have a few meta and detailed thoughts after reading it. 1) I agree that the current ratio metrics is just

[jira] [Created] (KAFKA-13075) Consolidate RocksDBStore and RocksDBKeyValueStoreTest

2021-07-12 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-13075: -- Summary: Consolidate RocksDBStore and RocksDBKeyValueStoreTest Key: KAFKA-13075 URL: https://issues.apache.org/jira/browse/KAFKA-13075 Project:

[jira] [Created] (KAFKA-13074) Implement mayClean for MockLog

2021-07-12 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-13074: -- Summary: Implement mayClean for MockLog Key: KAFKA-13074 URL: https://issues.apache.org/jira/browse/KAFKA-13074 Project: Kafka

[jira] [Created] (KAFKA-13073) Simulation test fails due to inconsistency in MockLog's implementation

2021-07-12 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-13073: -- Summary: Simulation test fails due to inconsistency in MockLog's implementation Key: KAFKA-13073 URL:

Re: [DISCUSS] KIP-405 + KAFKA-7739 - Implementation of Tiered Storage Integration with Azure Storage

2021-07-12 Thread Satish Duggana
Hi Sumant, We are tracking HDFS and S3 implementations as part of this project to see the proposed APIs are addressing file/object stores. As Jun mentioned in the earlier mail thread, no RSM implementation will be part of Apache Kafka. This is in line with Kafka Connectors development. Devs/Users

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #311

2021-07-12 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-13072) refactor RemoveMembersFromConsumerGroupHandler

2021-07-12 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13072: - Summary: refactor RemoveMembersFromConsumerGroupHandler Key: KAFKA-13072 URL: https://issues.apache.org/jira/browse/KAFKA-13072 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-13071) Deprecate and remove --authorizer option in kafka-acls.sh

2021-07-12 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-13071: --- Summary: Deprecate and remove --authorizer option in kafka-acls.sh Key: KAFKA-13071 URL: https://issues.apache.org/jira/browse/KAFKA-13071 Project: Kafka

[GitHub] [kafka-site] ableegoldman merged pull request #361: KAFKA-12993: fix memory-mgmt.html formatting

2021-07-12 Thread GitBox
ableegoldman merged pull request #361: URL: https://github.com/apache/kafka-site/pull/361 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-13070) LogManager shutdown races with periodic work scheduled by the instance

2021-07-12 Thread Kowshik Prakasam (Jira)
Kowshik Prakasam created KAFKA-13070: Summary: LogManager shutdown races with periodic work scheduled by the instance Key: KAFKA-13070 URL: https://issues.apache.org/jira/browse/KAFKA-13070

[jira] [Created] (KAFKA-13069) Add magic number to DefaultKafkaPrincipalBuilder.KafkaPrincipalSerde

2021-07-12 Thread Ron Dagostino (Jira)
Ron Dagostino created KAFKA-13069: - Summary: Add magic number to DefaultKafkaPrincipalBuilder.KafkaPrincipalSerde Key: KAFKA-13069 URL: https://issues.apache.org/jira/browse/KAFKA-13069 Project:

[jira] [Resolved] (KAFKA-10091) Improve task idling

2021-07-12 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-10091. -- Resolution: Fixed > Improve task idling > --- > > Key:

[jira] [Resolved] (KAFKA-12360) Improve documentation of max.task.idle.ms (kafka-streams)

2021-07-12 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-12360. -- Resolution: Fixed > Improve documentation of max.task.idle.ms (kafka-streams) >

[jira] [Created] (KAFKA-13068) Rename Log to UnifiedLog

2021-07-12 Thread Kowshik Prakasam (Jira)
Kowshik Prakasam created KAFKA-13068: Summary: Rename Log to UnifiedLog Key: KAFKA-13068 URL: https://issues.apache.org/jira/browse/KAFKA-13068 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-655: Windowed "Distinct" Operation for KStream

2021-07-12 Thread John Roesler
Hi all, Bruno raised some very good points. I’d like to chime in with additional context. 1. Great point. We faced a similar problem defining KIP-557. For 557, we chose to use the serialized byte array instead of the equals() method, but I think the situation in KIP-655 is a bit different. I

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

2021-07-12 Thread Konstantine Karantasis
Hi all, This is a reminder that Code Freeze for Apache Kafka 3.0 is coming up this week and is set to take place by the end of day Wednesday, July 14th. Currently in the project we have 22 blocker issues for 3.0, out of 41 total tickets targeting 3.0. You may find the list of open issues in the

[jira] [Resolved] (KAFKA-13040) Increase minimum value of segment.ms and segment.bytes

2021-07-12 Thread Badai Aqrandista (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Badai Aqrandista resolved KAFKA-13040. -- Resolution: Duplicate > Increase minimum value of segment.ms and segment.bytes >

[jira] [Reopened] (KAFKA-7760) Add broker configuration to set minimum value for segment.bytes and segment.ms

2021-07-12 Thread Badai Aqrandista (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Badai Aqrandista reopened KAFKA-7760: - Reopening issue and making this the main ticket for KIP-760 > Add broker configuration to

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

2021-07-12 Thread Konstantine Karantasis
Thanks for the update Levani, KIP-708 is now on the list of postponed KIPs. Konstantine On Thu, Jul 1, 2021 at 10:48 PM Levani Kokhreidze wrote: > Hi Konstantine, > > FYI, I don’t think we will be able to have KIP-708 ready on time. > Feel free to remove it from the release plan. > > Best, >

Re: [DISCUSS] KIP-405 + KAFKA-7739 - Implementation of Tiered Storage Integration with Azure Storage

2021-07-12 Thread Sumant Tambe
Hi Israel, Linkedin is interested in evaluating KIP-405 for HDFS and S3 in the short term and Azure Blob Storage in the long run. You may already know that Linkedin is migrating to Azure . We think that Blobs will provide us with the

[jira] [Resolved] (KAFKA-13003) KafkaBroker advertises socket port instead of the configured advertised port

2021-07-12 Thread Uwe Eisele (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Eisele resolved KAFKA-13003. Resolution: Fixed Pull Request #10935 has been merged. > KafkaBroker advertises socket port

[DISCUSS] KIP-761: Add total blocked time metric to streams

2021-07-12 Thread Rohan Desai
https://cwiki.apache.org/confluence/display/KAFKA/KIP-761%3A+Add+Total+Blocked+Time+Metric+to+Streams

[jira] [Created] (KAFKA-13067) KafkaMetadataLog should not use segment size smaller than KafkaRaftClient max batch size

2021-07-12 Thread David Arthur (Jira)
David Arthur created KAFKA-13067: Summary: KafkaMetadataLog should not use segment size smaller than KafkaRaftClient max batch size Key: KAFKA-13067 URL: https://issues.apache.org/jira/browse/KAFKA-13067

Re: [DISCUSS] KIP-477: Add PATCH method for connector config in Connect REST API

2021-07-12 Thread Chris Egerton
Hi all, Know it's been a while for this KIP but in my personal experience the value of a PATCH method in the REST API has actually increased over time and I'd love to have this option for quick, stop-the-bleeding remediation efforts. One thought that comes to mind is that sometimes it may be

Re: [DISCUSS] KIP-655: Windowed "Distinct" Operation for KStream

2021-07-12 Thread Bruno Cadonna
Hi Ivan, Thank you for the KIP! Some aspects are not clear to me from the KIP and I have a proposal. 1. The KIP does not describe the criteria that define a duplicate. Could you add a definition of duplicate to the KIP? 2. The KIP does not describe what happens if distinct() is applied on a

[jira] [Created] (KAFKA-13066) Replace EasyMock with Mockito for FileStreamSinkConnectorTest

2021-07-12 Thread Chun-Hao Tang (Jira)
Chun-Hao Tang created KAFKA-13066: - Summary: Replace EasyMock with Mockito for FileStreamSinkConnectorTest Key: KAFKA-13066 URL: https://issues.apache.org/jira/browse/KAFKA-13066 Project: Kafka

[jira] [Created] (KAFKA-13065) Replace EasyMock with Mockito for BasicAuthSecurityRestExtensionTest

2021-07-12 Thread Chun-Hao Tang (Jira)
Chun-Hao Tang created KAFKA-13065: - Summary: Replace EasyMock with Mockito for BasicAuthSecurityRestExtensionTest Key: KAFKA-13065 URL: https://issues.apache.org/jira/browse/KAFKA-13065 Project:

[VOTE] KIP-655: Windowed "Distinct" Operation for Kafka Streams

2021-07-12 Thread Ivan Ponomarev
Hello all! I'd like to start the vote for KIP-655 which proposes the zero-arg distict() method to be added to TimeWindowedKStream and SessionWindowedKStream. https://cwiki.apache.org/confluence/display/KAFKA/KIP-655%3A+Windowed+Distinct+Operation+for+Kafka+Streams+API Regards, Ivan

[jira] [Created] (KAFKA-13064) refactor ListConsumerGroupOffsetsHandler

2021-07-12 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13064: - Summary: refactor ListConsumerGroupOffsetsHandler Key: KAFKA-13064 URL: https://issues.apache.org/jira/browse/KAFKA-13064 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-13063) refactor DescribeConsumerGroupsHandler

2021-07-12 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13063: - Summary: refactor DescribeConsumerGroupsHandler Key: KAFKA-13063 URL: https://issues.apache.org/jira/browse/KAFKA-13063 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-13062) refactor DeleteConsumerGroupsHandler

2021-07-12 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13062: - Summary: refactor DeleteConsumerGroupsHandler Key: KAFKA-13062 URL: https://issues.apache.org/jira/browse/KAFKA-13062 Project: Kafka Issue Type: Sub-task