[jira] [Resolved] (KAFKA-18205) Refactor share coordinator and related classes for better readability and organization

2025-08-04 Thread Sushant Mahajan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushant Mahajan resolved KAFKA-18205. - Resolution: Fixed This was a placeholder and the coordinator is in better shape over mul

Re: [DISCUSS] KIP-1187: Support to retrieve remote log size via DescribeLogDirs RPC

2025-08-04 Thread Satish Duggana
Hi PoAn, Thanks for the KIP, this is a valuable feature for operators to get better visibility into partition sizes across both local and remote storage. While RemoteLogSegmentMetadata provides segment-level details to help developers build custom utilities, it's beneficial to enhance the existing

[jira] [Resolved] (KAFKA-19579) Add missing metrics for document tiered storage

2025-08-04 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19579. Fix Version/s: 4.2.0 Resolution: Fixed > Add missing metrics for document tiered st

[jira] [Created] (KAFKA-19580) Upgrade spotbug to 4.9.4

2025-08-04 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19580: -- Summary: Upgrade spotbug to 4.9.4 Key: KAFKA-19580 URL: https://issues.apache.org/jira/browse/KAFKA-19580 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-19576) Fix typo in state-change log filename after rotate

2025-08-04 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19576. Resolution: Fixed trunk: https://github.com/apache/kafka/commit/66b3c07954c94ed2f3c7dec95

Re: [DISCUSS] KIP-1066: Mechanism to cordon brokers and log directories

2025-08-04 Thread Jun Rao
Hi, Mickael, Thanks for the updated KIP. LGTM Jun On Thu, Jul 31, 2025 at 7:03 AM Mickael Maison wrote: > Hi Jun, > > There wasn't a technical reason why this is the case. > > BrokerHeartbeatRequest already used a tagged field for OfflineLogDirs. > Since CordonedLogDirs works the same way as O

[jira] [Created] (KAFKA-19579) Add missing metrics for document tiered storage

2025-08-04 Thread majialong (Jira)
majialong created KAFKA-19579: - Summary: Add missing metrics for document tiered storage Key: KAFKA-19579 URL: https://issues.apache.org/jira/browse/KAFKA-19579 Project: Kafka Issue Type: Task

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

2025-08-04 Thread Omnia Ibrahim
Hi Jun > JR11. value.serializers and value.deserializers: Should they be of type > List? Also, where are key.serializers and key.deserializers? > Updated now > JR12. Do we still need ComposableSerializer and ComposableDeserializer? The initial thinking here was if `value.serializers or value.dese

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

2025-08-04 Thread Omnia Ibrahim
Hi Fede; > FV1: Looking at PayloadStore and PayloadResponse, "id" and "path" > seems to be the same thing, which is a reference to the data in the > external store. If my interpretation is correct, could we converge to > using one of the two terms? Path usually refers to the full path stored in K

Re: Kafka Consumer Not Receiving Messages Until Restart

2025-08-04 Thread Matthias J. Sax
Hello Waseem, we only maintain the Java clients, which are part of Apache Kafka project. The ruby clients is a third part client, and I don't think anybody would know much about it. It might be best, to reach out to the maintainers of the ruby client and ask them for help. Or maybe try the u

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

2025-08-04 Thread Jun Rao
Hi, Jiunn-Yang, Thanks for the reply. JR46. "Currently, if plugin.path is set to an empty list, no user-specified plugin locations are processed, but plugins from the parent classloader are still loaded." Could you add why the current behavior is bad for the users? JR48. If we want to preserve t

[jira] [Created] (KAFKA-19578) Fix flaky RemoteLogManagerTest#testCopyQuota

2025-08-04 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19578: -- Summary: Fix flaky RemoteLogManagerTest#testCopyQuota Key: KAFKA-19578 URL: https://issues.apache.org/jira/browse/KAFKA-19578 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-19577) Allow to configure custom `ReplicaPlacer` implementation

2025-08-04 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19577: -- Summary: Allow to configure custom `ReplicaPlacer` implementation Key: KAFKA-19577 URL: https://issues.apache.org/jira/browse/KAFKA-19577 Project: Kafka

Re: Kafka Consumer Not Receiving Messages Until Restart

2025-08-04 Thread Martin Andersson
Hi Waseem This sounds like either an environment issue (i.e. something other than the kafka client/broker), or a client issue. In any case, you probably want to ask the developers of the ruby client instead. Regards, From: Waseem Anwar Sent: Friday, August 1, 2

Re: [DISCUSS] KIP-1201: Add disk threshold strategy to prevent disk full failure

2025-08-04 Thread Martin Andersson
Hello Peng. > In most use cases, Kafka serves as a messaging middleware where messages that have already been consumed are typically no longer needed and can be safely deleted. I don't think we can make these kind of assumptions about how Kafka is used. In any case, defining which consumer group

Re: [VOTE] 4.1.0 RC1

2025-08-04 Thread Mickael Maison
Hi Luke, Thanks for the heads up. I replied in the PR associated with the discussion. I'll copy my reply here too so everyone is aware: I think it's fine to merge this as this renaming was accidental and unwanted. However we should probably add a note in notable changes in 4.0.0 to indicate the n

Re: [DISCUSS]: KIP-1191: Dead-letter queues for share groups

2025-08-04 Thread Andrew Schofield
Hi, Thanks for your comments on the KIP and sorry for the delay in responding. D01: Authorisation is the area of this KIP that I think is most tricky. The reason that I didn't implement specific ACLs for DLQs because I was not convinced they would help. So, if you have a specific idea in mind, p

Re: [VOTE] KIP-1187: Support to retrieve remote log size

2025-08-04 Thread Chia-Ping Tsai
hi PoAn I have a few questions about this KIP. Please check the discussion thread. thanks, Chia-Ping On 2025/08/04 07:37:18 PoAn Yang wrote: > Hi all, > > I would like to start a vote on KIP-1187. Thank you. > > KIP: https://cwiki.apache.org/confluence/x/sYkhFg > > Discussion thread: > http

Re: [DISCUSS] KIP-1187: Support to retrieve remote log size via DescribeLogDirs RPC

2025-08-04 Thread Chia-Ping Tsai
hi PoAn chia_03: what is the difference between `OnlyLocalLogSize` and `PartitionSize`? Am I correct in assuming that `PartitionSize` = RemoteLogSize + OnlyLocalLogSize? chia_04: could you please consider renaming `onlyLocalSize` to `localSize` for consistency? chia_05: should we use optional

[jira] [Resolved] (KAFKA-19437) Review incidence of null metadata image in share coordinator

2025-08-04 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-19437. --- Resolution: Fixed > Review incidence of null metadata image in share coordinator > -

Re: [DISCUSS] KIP-1187: Support to retrieve remote log size via DescribeLogDirs RPC

2025-08-04 Thread Kamal Chandraprakash
Hi PoAn, One comment: Shall the `IncludeRemoteInfo` be defined one layer above in DescribeLogDirsRequest instead of DescribableLogDirTopic? The default value of DescribableLogDirTopics is null: https://sourcegraph.com/github.com/apache/kafka/-/blob/clients/src/main/java/org/apache/kafka/clients/a

[jira] [Created] (KAFKA-19576) Fix typo in state-change log filename after rotate

2025-08-04 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19576: -- Summary: Fix typo in state-change log filename after rotate Key: KAFKA-19576 URL: https://issues.apache.org/jira/browse/KAFKA-19576 Project: Kafka Issue

[jira] [Resolved] (KAFKA-18607) Update jfreechart dependency

2025-08-04 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-18607. Fix Version/s: 4.2.0 Resolution: Fixed > Update jfreechart dependency > ---

Re: [VOTE] KIP-1187: Support to retrieve remote log size

2025-08-04 Thread Kamal Chandraprakash
+1 (binding). Thanks for the KIP! Thanks, Kamal On Mon, Aug 4, 2025 at 1:07 PM PoAn Yang wrote: > Hi all, > > I would like to start a vote on KIP-1187. Thank you. > > KIP: https://cwiki.apache.org/confluence/x/sYkhFg > > Discussion thread: > https://lists.apache.org/thread/bd6y65qro8fj548rpdrm3

[jira] [Created] (KAFKA-19575) Revisit gradle/spotbugs-exclude.xml

2025-08-04 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19575: -- Summary: Revisit gradle/spotbugs-exclude.xml Key: KAFKA-19575 URL: https://issues.apache.org/jira/browse/KAFKA-19575 Project: Kafka Issue Type: Improveme

[jira] [Created] (KAFKA-19574) Improve producer and consumer config files

2025-08-04 Thread Federico Valeri (Jira)
Federico Valeri created KAFKA-19574: --- Summary: Improve producer and consumer config files Key: KAFKA-19574 URL: https://issues.apache.org/jira/browse/KAFKA-19574 Project: Kafka Issue Type:

[VOTE] KIP-1187: Support to retrieve remote log size

2025-08-04 Thread PoAn Yang
Hi all, I would like to start a vote on KIP-1187. Thank you. KIP: https://cwiki.apache.org/confluence/x/sYkhFg Discussion thread: https://lists.apache.org/thread/bd6y65qro8fj548rpdrm3lxqomqo75x8 Regards, PoAn

[jira] [Created] (KAFKA-19573) Update num.recovery.threads.per.data.dir configs

2025-08-04 Thread Federico Valeri (Jira)
Federico Valeri created KAFKA-19573: --- Summary: Update num.recovery.threads.per.data.dir configs Key: KAFKA-19573 URL: https://issues.apache.org/jira/browse/KAFKA-19573 Project: Kafka Issue

Re: [VOTE] KIP-1160: Enable returning supported features from a specific broker

2025-08-04 Thread PoAn Yang
Hi all, Thanks for your voting and participation. The KIP-1160 has been accepted with 3 binding +1 from Andrew Schofield, TengYao Chi, and Chia-Ping Tsai. Also, getting 1 non-binding +1 from Federico Valeri. Thanks for everyone. Regards, PoAn > On Aug 3, 2025, at 8:08 PM, Chia-Ping Tsai wrot