Re: Kafka consumer group crashing and not able to consume once service is up

2024-02-07 Thread Philip Nee
Hi Santhosh, Your problem statement confuses me a bit (apologize). You mentioned "if one of the kafka consumer(Service)" - Do you have a single member consumer group? Could you elaborate on the setup a bit? Did you also mean after restarting the "service", the service was not able to resume from

RE: Kafka consumer group crashing and not able to consume once service is up

2024-02-07 Thread Marigowda, Santhosh Aditya
Hi Dev team, Could you Please let me know if any updates on my query. Thanks, Santhosh Aditya From: Marigowda, Santhosh Aditya Sent: Wednesday, January 31, 2024 8:50 AM To: dev@kafka.apache.org Cc: Jain, Ankit ; Namboodiri, Vishnu ; Mudlapur, Rajesh ; Reddy, Thanmai Subject: RE: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2628

2024-02-07 Thread Apache Jenkins Server
See Changes: -- [...truncated 231730 lines...] [2024-02-08T04:37:05.611Z] Gradle Test Run :core:test > Gradle Test Executor 95 > ReassignPartitionsZNodeTest >

Re: [DISCUSS] KIP-996: Pre-Vote

2024-02-07 Thread ziming deng
Hi Alyssa, I have a minor question about the description in motivation section > Pre-Vote (as originally detailed in the Raft paper and in KIP-650) It seems Pre-vote is not mentioned in Raft paper, can you check out it again and rectify it? It would be helpful, thank you! - Thanks, Ziming

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #142

2024-02-07 Thread Apache Jenkins Server
See Changes: -- [...truncated 312328 lines...] [2024-02-08T01:54:12.817Z] Gradle Test Run :core:test > Gradle Test Executor 93 > KafkaZkClientTest >

Re: Kafka-Streams-Scala for Scala 3

2024-02-07 Thread Matthias Berndt
Hi Matthias J., Hi Lucas, Hi Josep, Thank you for your encouraging responses regarding a Scala 3 port of Kafka-Streams-Scala, and apologies for the late response from my side. I have now created a PR to port Kafka-Streams-Scala to Scala 3 (while retaining support for 2.13 and 2.12). Almost no

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #91

2024-02-07 Thread Apache Jenkins Server
See Changes: -- [...truncated 343083 lines...] [2024-02-08T00:38:40.875Z] Gradle Test Run :core:test > Gradle Test Executor 95 > ZkMigrationIntegrationTest >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2627

2024-02-07 Thread Apache Jenkins Server
See Changes: -- [...truncated 345849 lines...] [2024-02-08T00:28:22.433Z] Gradle Test Run :core:test > Gradle Test Executor 75 > KafkaZkClientTest >

[jira] [Created] (KAFKA-16235) auto commit still causes delays due to retriable UNKNOWN_TOPIC_OR_PARTITION

2024-02-07 Thread Ryan Leslie (Jira)
Ryan Leslie created KAFKA-16235: --- Summary: auto commit still causes delays due to retriable UNKNOWN_TOPIC_OR_PARTITION Key: KAFKA-16235 URL: https://issues.apache.org/jira/browse/KAFKA-16235 Project:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2626

2024-02-07 Thread Apache Jenkins Server
See Changes: -- [...truncated 403827 lines...] [2024-02-07T18:20:15.633Z] Gradle Test Run :connect:runtime:test > Gradle Test Executor 50 >

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2024-02-07 Thread Jun Rao
Hi, Artem, Thanks for the reply. 20. So to abort a prepared transaction after producer start, we could use either producer.initTransactions(false) or producer.initTransactions(true) producer.abortTransaction Could we just always use the latter API? If we do this, we could potentially

[jira] [Created] (KAFKA-16234) Log directory failure re-creates partitions in another logdir automatically

2024-02-07 Thread Gaurav Narula (Jira)
Gaurav Narula created KAFKA-16234: - Summary: Log directory failure re-creates partitions in another logdir automatically Key: KAFKA-16234 URL: https://issues.apache.org/jira/browse/KAFKA-16234

Re: [VOTE] KIP-390: Support Compression Level (rebooted)

2024-02-07 Thread Mickael Maison
Hi Divij, Thanks for bringing that point. After reading KIP-984, I don't think it supersedes KIP-390/KIP-780. Being able to tune the built-in codecs would directly benefit many users. It may also cover some scenarios that motivated KIP-984 without requiring users to write a custom codec. I've not

[jira] [Created] (KAFKA-16233) Review auto-commit continuously committing when no progress

2024-02-07 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-16233: -- Summary: Review auto-commit continuously committing when no progress Key: KAFKA-16233 URL: https://issues.apache.org/jira/browse/KAFKA-16233 Project: Kafka

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2625

2024-02-07 Thread Apache Jenkins Server
See

Re: KRaft controller number of replicas

2024-02-07 Thread Daniel Saiz
Thanks a lot folks, this is really helpful. > I believe the limitation that this documentation is hinting at is the > motivation for KIP-996 I'll make sure to check out KIP-996 and the references linked there. Thanks for the summary as well, I really appreciate it. Cheers, Dani On Tue, Feb

Re: [VOTE] KIP-390: Support Compression Level (rebooted)

2024-02-07 Thread Divij Vaidya
Hey Mickael Since this KIP was written, we have a new proposal to make the compression completely pluggable https://cwiki.apache.org/confluence/display/KAFKA/KIP-984%3A+Add+pluggable+compression+interface+to+Kafka. If we implement that KIP, would it supersede the need for adding fine grain

Re: [VOTE] KIP-390: Support Compression Level (rebooted)

2024-02-07 Thread Mickael Maison
Hi, I'm resurrecting this old thread as this KIP would be a nice improvement and almost 3 years later the PR for this KIP has still not been merged! The reason is that during reviews we noticed the proposed configuration, compression.level, was not easy to use as each codec has its own valid