[jira] [Created] (KAFKA-14906) Extract the coordinator service log from server log

2023-04-13 Thread hudeqi (Jira)
hudeqi created KAFKA-14906: -- Summary: Extract the coordinator service log from server log Key: KAFKA-14906 URL: https://issues.apache.org/jira/browse/KAFKA-14906 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-14139) Replaced disk can lead to loss of committed data even with non-empty ISR

2023-04-13 Thread Calvin Liu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu resolved KAFKA-14139. Resolution: Fixed > Replaced disk can lead to loss of committed data even with non-empty ISR >

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1762

2023-04-13 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-14905) Failing tests in MM2 ForwardingAdmin test since KIP-894

2023-04-13 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14905: --- Summary: Failing tests in MM2 ForwardingAdmin test since KIP-894 Key: KAFKA-14905 URL: https://issues.apache.org/jira/browse/KAFKA-14905 Project: Kafka Issue

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1761

2023-04-13 Thread Apache Jenkins Server
See Changes: -- [...truncated 465544 lines...] [2023-04-13T23:37:59.599Z] [2023-04-13T23:37:59.599Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181

Re: [DISCUSS] Re-visit end of life policy

2023-04-13 Thread Ismael Juma
Clarification below. I did not understand your point about maintenance expense to ensure > compatibility. I am confused because, IMO, irrespective of our bug fix > support duration for minor versions, we should ensure that all prior minor > versions are compatible. Hence, increasing the support

Re: Fwd: [VOTE] KIP-914 Join Processor Semantics for Versioned Stores

2023-04-13 Thread Victoria Xia
Hey everyone, Two more minor updates to the KIP came out of wrapping up the implementation and discussions with Guozhang and Matthias offline: - Versioned stores will be disabled for global tables and also the suppress operator, in order to limit the scope of these changes and to

[jira] [Created] (KAFKA-14904) Flaky Test kafka.api.TransactionsBounceTest.testWithGroupId()

2023-04-13 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-14904: -- Summary: Flaky Test kafka.api.TransactionsBounceTest.testWithGroupId() Key: KAFKA-14904 URL: https://issues.apache.org/jira/browse/KAFKA-14904 Project: Kafka

Max Multi Tenancy topic naming - Cloudflare

2023-04-13 Thread Kenneth Eversole
Hello, I am on the Kafka team at Cloudflare, and I was hoping to find an answer on what the max value is for the following subject, https://kafka.apache.org/documentation/#multitenancy-topic-naming. We are looking this for a workload that would bring us in the 100,000s of topics. I look forward

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1760

2023-04-13 Thread Apache Jenkins Server
See

Re: [DISCUSS] Re-visit end of life policy

2023-04-13 Thread Divij Vaidya
Thank you for your comments, Ismael. 1. About the last major version release: There is precedence in open source projects such as Spark, Pulsar etc. that are already offering a LTS/major version support with longer support duration than Kafka. If we limit our support to include production

Re: [VOTE] KIP-909: DNS Resolution Fallures Should Not Fail the Client

2023-04-13 Thread Kirk True
+1 (non-binding) > On Apr 10, 2023, at 1:53 PM, Philip Nee wrote: > > Hey everyone! > > I'm starting a vote for KIP-909: DNS Resolution Fallures Should Not Fail > the Client > > Please refer to the discussion thread here: >

Re: [DISCUSS] Re-visit end of life policy

2023-04-13 Thread Ismael Juma
Hi, I think we're discussing two separate things and each has a very different cost and benefit: 1. Having a longer support period for the last minor release: major releases happen pretty rarely and have breaking changes. It seems reasonable to consider improving how this case is handled. And it

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1759

2023-04-13 Thread Apache Jenkins Server
See Changes: -- [...truncated 467254 lines...] [2023-04-13T13:34:51.100Z] > Task :server-common:testClasses UP-TO-DATE [2023-04-13T13:34:51.100Z] > Task

[DISCUSS] KIP-918: MM2 Topic And Group Listener

2023-04-13 Thread Dániel Urbán
Hi everyone, I would like to start a discussion on KIP-918: MM2 Topic And Group Listener ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-918%3A+MM2+Topic+And+Group+Listener ). This new feature of MM2 would allow following the latest set of replicated topics and groups, which is currently

[DISCUSS] Re-visit end of life policy

2023-04-13 Thread Divij Vaidya
Hi folks The goal of this discussion is to re-visit the End Of Life (EOL) policy of Kafka and introduce a few changes to it. *Current EOL policy* Kafka currently follows a time based release plan with an EOL policy documented here:

Re: [DISCUSS] KIP-916: MM2 distributed mode flow log context

2023-04-13 Thread Dániel Urbán
Hi everyone, I would like to bump this thread. I think this would be very useful for any MM2 users, as the current logs with certain architectures (e.g. fan-out) are impossible to decipher. I already submitted a PR to demonstrate the proposed solution: https://github.com/apache/kafka/pull/13475

[jira] [Created] (KAFKA-14903) MM2 Topic And Group Listener (KIP-918)

2023-04-13 Thread Daniel Urban (Jira)
Daniel Urban created KAFKA-14903: Summary: MM2 Topic And Group Listener (KIP-918) Key: KAFKA-14903 URL: https://issues.apache.org/jira/browse/KAFKA-14903 Project: Kafka Issue Type: New

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-04-13 Thread David Jacot
Hi Mickael, Thanks for the heads up. As raised by Jeff earlier in this thread, we would like to get the two small patches [1][2] for KIP-915 in 3.5. The PRs are in review and I should be able to merge them in the next few days. I will cherry-pick them to the release branch in your create it in

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-04-13 Thread Mickael Maison
Hi Luke, Thanks for the heads up. This would be great to get Tiered Storage in Early Access. Let me know if you can't get everything done this week. Mickael On Thu, Apr 13, 2023 at 12:54 PM Mickael Maison wrote: > > Hi, > > We've now reached feature freeze for 3.5.0. From now on, only bug >

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-04-13 Thread Mickael Maison
Hi, We've now reached feature freeze for 3.5.0. From now on, only bug fixes and changes related to stabilizing the release should be merged. I plan to create the release branch tomorrow (Friday 14). After this point, you'll have to cherry pick changes to the release branch when merging a PR.

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1758

2023-04-13 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-14902) KafkaBasedLog infinite retries can lead to StackOverflowError

2023-04-13 Thread Daniel Urban (Jira)
Daniel Urban created KAFKA-14902: Summary: KafkaBasedLog infinite retries can lead to StackOverflowError Key: KAFKA-14902 URL: https://issues.apache.org/jira/browse/KAFKA-14902 Project: Kafka

A question about topic limit in produceBytesIn

2023-04-13 Thread hudeqi
Another question about using kafka recently: Currently, Kafka's write throttle only supports the user dimension and clientId dimension of the request. In fact, such a situation is often encountered in actual use: a topic entry traffic suddenly increases, and the resource bottleneck is about

A question about the reassign task in kafka

2023-04-13 Thread hudeqi
One question were found in the process of using kafka recently: Why does Kafka start fetching from the leader's logStartOffset when Kafka is doing the topic reassign task (such as cluster expansion brokers)? If the amount of data stored locally by the partition leader is large, the disk IO

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1757

2023-04-13 Thread Apache Jenkins Server
See