Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #84

2024-02-01 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16218) Partition reassignment can't complete if any target replica is out-of-sync

2024-02-01 Thread Drawxy (Jira)
Drawxy created KAFKA-16218: -- Summary: Partition reassignment can't complete if any target replica is out-of-sync Key: KAFKA-16218 URL: https://issues.apache.org/jira/browse/KAFKA-16218 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2612

2024-02-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #83

2024-02-01 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16216) Reduce batch size for initial metadata load during ZK migration

2024-02-01 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-16216. -- Fix Version/s: 3.7.0 Reviewer: Colin McCabe Assignee: David Arthur (was:

[jira] [Created] (KAFKA-16217) Transactional producer stuck in IllegalStateException during close

2024-02-01 Thread Calvin Liu (Jira)
Calvin Liu created KAFKA-16217: -- Summary: Transactional producer stuck in IllegalStateException during close Key: KAFKA-16217 URL: https://issues.apache.org/jira/browse/KAFKA-16217 Project: Kafka

[jira] [Created] (KAFKA-16216) Reduce batch size for initial metadata load during ZK migration

2024-02-01 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-16216: Summary: Reduce batch size for initial metadata load during ZK migration Key: KAFKA-16216 URL: https://issues.apache.org/jira/browse/KAFKA-16216 Project: Kafka

Re: ZK vs KRaft benchmarking - latency differences?

2024-02-01 Thread Michael K. Edwards
The interesting numbers are the recovery times after 1) the Kafka broker currently acting as the "active" controller (or the sole controller in a ZooKeeper-based deployment) goes away; 2) the Kafka broker currently acting as the consumer group coordinator for a consumer group with many partitions

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2611

2024-02-01 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15691) Add new system tests to use new consumer

2024-02-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-15691. --- Resolution: Duplicate > Add new system tests to use new consumer >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2610

2024-02-01 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15575) Prevent Connectors from exceeding tasks.max configuration

2024-02-01 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-15575. --- Fix Version/s: 3.8.0 Resolution: Fixed > Prevent Connectors from exceeding tasks.max

Re: [DISCUSS] KIP-1018: Introduce max remote fetch timeout config

2024-02-01 Thread Kamal Chandraprakash
Hi Jorge, Thanks for the review! Added your suggestions to the KIP. PTAL. The `fetch.max.wait.ms` config will be also applicable for topics enabled with remote storage. Updated the description to: ``` The maximum amount of time the server will block before answering the fetch request when it is

Re: Kafka-Streams-Scala for Scala 3

2024-02-01 Thread Josep Prat
Hi, For reference, prior work on this: https://github.com/apache/kafka/pull/11350 https://github.com/apache/kafka/pull/11432 Best, On Thu, Feb 1, 2024, 15:55 Lucas Brutschy wrote: > Hi Matthiases, > > I know Scala 2 fairly well, so I'd be happy to review changes that add > Scala 3 support.

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

2024-02-01 Thread Jack Vanlightly
Hi Jose, I have a question about how voters and observers, which are far behind the leader, catch-up when there are multiple reconfiguration commands in the log between their position and the end of the log. Here are some example situations that need clarification: Example 1 Imagine a cluster

Re: ZK vs KRaft benchmarking - latency differences?

2024-02-01 Thread Doğuşcan Namal
Hi Paul, I did some benchmarking as well and couldn't find a marginal difference between KRaft and Zookeeper on end to end latency from producers to consumers. I tested it on Kafka version 3.5.1 and used openmessaging's benchmarking framework https://openmessaging.cloud/docs/benchmarks/ . What I

Re: Kafka-Streams-Scala for Scala 3

2024-02-01 Thread Lucas Brutschy
Hi Matthiases, I know Scala 2 fairly well, so I'd be happy to review changes that add Scala 3 support. However, as Matthias S. said, it has to be driven by people who use Scala day-to-day, since I believe most Kafka Streams committers are working with Java. Rewriting the tests to not use

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

2024-02-01 Thread Francois Visconte
Hi, I see that the ticket has been left untouched since a while now. Should it be included in the tiered storage v1? We've observed that lacking a way to throttle uploads to tiered storage has a major impact on producers and consumers when tiered storage access recovers (starving disk

[jira] [Created] (KAFKA-16215) Consumer does not rejoin after fenced on delayed revocation

2024-02-01 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-16215: -- Summary: Consumer does not rejoin after fenced on delayed revocation Key: KAFKA-16215 URL: https://issues.apache.org/jira/browse/KAFKA-16215 Project: Kafka

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2609

2024-02-01 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16189) Extend admin to support ConsumerGroupDescribe API

2024-02-01 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16189. - Fix Version/s: 3.8.0 Resolution: Fixed > Extend admin to support ConsumerGroupDescribe

[jira] [Resolved] (KAFKA-16168) Implement GroupCoordinator.onPartitionsDeleted

2024-02-01 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16168. - Fix Version/s: 3.8.0 Resolution: Fixed > Implement GroupCoordinator.onPartitionsDeleted