Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2903

2024-05-14 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16671) Revisit SessionedProtocolIntegrationTest.ensureInternalEndpointIsSecured

2024-05-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16671. Fix Version/s: 3.8.0 Resolution: Fixed > Revisit

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-05-14 Thread Sophie Blee-Goldman
Hey all, I have a few updates to mention that have come up during the implementation phase. The KIP should reflect the latest proposal and what has been merged so far, but I'll list everything again here so that you don't have to sift through the entire KIP: U1: The KafkaStreamsAssignment

Re: [VOTE] KIP-989: RocksDB Iterator Metrics

2024-05-14 Thread Sophie Blee-Goldman
+1 (binding) Thanks! On Tue, May 14, 2024 at 6:58 PM Matthias J. Sax wrote: > +1 (binding) > > On 5/14/24 9:19 AM, Lucas Brutschy wrote: > > Hi Nick! > > > > Thanks for the KIP. > > > > +1 (binding) > > > > On Tue, May 14, 2024 at 5:16 PM Nick Telford > wrote: > >> > >> Hi everyone, > >> > >>

Re: [VOTE] KIP-989: RocksDB Iterator Metrics

2024-05-14 Thread Matthias J. Sax
+1 (binding) On 5/14/24 9:19 AM, Lucas Brutschy wrote: Hi Nick! Thanks for the KIP. +1 (binding) On Tue, May 14, 2024 at 5:16 PM Nick Telford wrote: Hi everyone, I'd like to call a vote on the Kafka Streams KIP-989: RocksDB Iterator Metrics:

[jira] [Created] (KAFKA-16768) SocketServer leaks accepted SocketChannel instances due to race condition

2024-05-14 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16768: --- Summary: SocketServer leaks accepted SocketChannel instances due to race condition Key: KAFKA-16768 URL: https://issues.apache.org/jira/browse/KAFKA-16768 Project:

[jira] [Resolved] (KAFKA-15170) CooperativeStickyAssignor cannot adjust assignment correctly

2024-05-14 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-15170. Resolution: Fixed > CooperativeStickyAssignor cannot adjust assignment

[jira] [Created] (KAFKA-16767) KRaft should track HWM outside the log layer

2024-05-14 Thread Jira
José Armando García Sancio created KAFKA-16767: -- Summary: KRaft should track HWM outside the log layer Key: KAFKA-16767 URL: https://issues.apache.org/jira/browse/KAFKA-16767 Project:

Re: [DISCUSS] KIP-989: RocksDB Iterator Metrics

2024-05-14 Thread Nick Telford
Woops! Thanks for the catch Lucas. Given this was just a typo, I don't think this affects the voting. Cheers, Nick On Tue, 14 May 2024 at 18:06, Lucas Brutschy wrote: > Hi Nick, > > you are still referring to oldest-open-iterator-age-ms in the > `Proposed Changes` section. > > Cheers, > Lucas

[jira] [Created] (KAFKA-16766) New consumer offsetsForTimes timeout exception does not have the proper message

2024-05-14 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-16766: -- Summary: New consumer offsetsForTimes timeout exception does not have the proper message Key: KAFKA-16766 URL: https://issues.apache.org/jira/browse/KAFKA-16766

[jira] [Created] (KAFKA-16765) NioEchoServer leaks accepted SocketChannel instances due to race condition

2024-05-14 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16765: --- Summary: NioEchoServer leaks accepted SocketChannel instances due to race condition Key: KAFKA-16765 URL: https://issues.apache.org/jira/browse/KAFKA-16765 Project:

[jira] [Created] (KAFKA-16764) New consumer should throw InvalidTopicException on poll when invalid topic in metadata

2024-05-14 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-16764: -- Summary: New consumer should throw InvalidTopicException on poll when invalid topic in metadata Key: KAFKA-16764 URL: https://issues.apache.org/jira/browse/KAFKA-16764

Re:[VOTE] KIP-1028: Docker Official Image for Apache Kafka

2024-05-14 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
+1 (non-binding) Thanks Vedarth! From: dev@kafka.apache.org At: 05/14/24 12:13:14 UTC-4:00To: dev@kafka.apache.org Subject: [VOTE] KIP-1028: Docker Official Image for Apache Kafka Hi everyone, I'd like to call a vote on KIP-1028 which aims to introduce a JVM based Docker Official Image (DOI)

Re: [VOTE] KIP-1028: Docker Official Image for Apache Kafka

2024-05-14 Thread Justine Olshan
+1 (binding) from me as well. Thanks for working on the KIP. Justine On Tue, May 14, 2024 at 9:20 AM Manikumar wrote: > +1 (binding) > > Thanks for the KIP. > > > > > > On Tue, May 14, 2024, 9:46 PM Chris Egerton > wrote: > > > +1 (binding), thanks for the KIP! > > > > On Tue, May 14, 2024,

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-14 Thread Greg Harris
Hey Chris, Thanks for your comments. I'm glad you like the motivations, Snehashis wrote that part! > the configuration syntax for the most basic use case of > specifying a single desired version is pretty counterintuitive. I agree, and the "soft" requirement scheme is something I wasn't

Re: [DISCUSS] KIP-989: RocksDB Iterator Metrics

2024-05-14 Thread Lucas Brutschy
Hi Nick, you are still referring to oldest-open-iterator-age-ms in the `Proposed Changes` section. Cheers, Lucas On Thu, May 2, 2024 at 4:00 PM Lucas Brutschy wrote: > > Hi Nick! > > I agree, the age variant is a bit nicer since the semantics are very > clear from the name. If you'd rather go

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

2024-05-14 Thread Nick Telford
Hi everyone, Sorry for the delay in replying. I've finally now got some time to work on this. Addressing Matthias's comments: 100. Good point. As Bruno mentioned, there's already AbstractReadWriteDecorator which we could leverage to provide that protection. I'll add details on this to the KIP.

[jira] [Created] (KAFKA-16763) Upgrade to scala 2.12.19 and scala 2.13.14

2024-05-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16763: -- Summary: Upgrade to scala 2.12.19 and scala 2.13.14 Key: KAFKA-16763 URL: https://issues.apache.org/jira/browse/KAFKA-16763 Project: Kafka Issue Type:

Re: [VOTE] KIP-989: RocksDB Iterator Metrics

2024-05-14 Thread Lucas Brutschy
Hi Nick! Thanks for the KIP. +1 (binding) On Tue, May 14, 2024 at 5:16 PM Nick Telford wrote: > > Hi everyone, > > I'd like to call a vote on the Kafka Streams KIP-989: RocksDB Iterator > Metrics: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-989%3A+RocksDB+Iterator+Metrics > > All

Re: [VOTE] KIP-1028: Docker Official Image for Apache Kafka

2024-05-14 Thread Manikumar
+1 (binding) Thanks for the KIP. On Tue, May 14, 2024, 9:46 PM Chris Egerton wrote: > +1 (binding), thanks for the KIP! > > On Tue, May 14, 2024, 12:13 Vedarth Sharma > wrote: > > > Hi everyone, > > > > I'd like to call a vote on KIP-1028 which aims to introduce a JVM based > > Docker

Re: [VOTE] KIP-1028: Docker Official Image for Apache Kafka

2024-05-14 Thread Chris Egerton
+1 (binding), thanks for the KIP! On Tue, May 14, 2024, 12:13 Vedarth Sharma wrote: > Hi everyone, > > I'd like to call a vote on KIP-1028 which aims to introduce a JVM based > Docker Official Image (DOI) for Apache Kafka. > > KIP - > >

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-14 Thread Chris Egerton
Hi all, Thanks Greg for updating the KIP, and thanks Snehashis for starting the work on this originally. The motivation section makes a pretty convincing case for this kind of feature. My thoughts are mostly about specific details: 1) I like the support for version ranges (the example

[VOTE] KIP-1028: Docker Official Image for Apache Kafka

2024-05-14 Thread Vedarth Sharma
Hi everyone, I'd like to call a vote on KIP-1028 which aims to introduce a JVM based Docker Official Image (DOI) for Apache Kafka. KIP - https://cwiki.apache.org/confluence/display/KAFKA/KIP-1028%3A+Docker+Official+Image+for+Apache+Kafka Discussion thread -

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

2024-05-14 Thread Christopher Shannon
I just wanted to bump this and see if anyone had more feedback before trying to call a vote for this for 4.0? Chris On Mon, Apr 1, 2024 at 3:41 PM Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > Greg, > > 1. Ok sounds good we can target JDK 17 in this KIP if we decide to do

[jira] [Created] (KAFKA-16762) SyncGroup API for upgrading ConsumerGroup

2024-05-14 Thread Dongnuo Lyu (Jira)
Dongnuo Lyu created KAFKA-16762: --- Summary: SyncGroup API for upgrading ConsumerGroup Key: KAFKA-16762 URL: https://issues.apache.org/jira/browse/KAFKA-16762 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-16406) Split long-running consumer integration test

2024-05-14 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-16406. Resolution: Fixed > Split long-running consumer integration test >

Re: [VOTE] KIP-1033: Add Kafka Streams exception handler for exceptions occurring during processing

2024-05-14 Thread Lianet M.
+1 (non-binding) Thanks for the KIP and updates! Lianet On Tue, May 14, 2024, 12:03 a.m. Matthias J. Sax wrote: > +1 (binding) > > On 5/13/24 5:54 PM, Sophie Blee-Goldman wrote: > > Thanks for the KIP guys! > > > > +1 (binding) > > > > On Mon, May 13, 2024 at 6:02 AM Bill Bejeck wrote: > > >

Re: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

2024-05-14 Thread Vedarth Sharma
Thanks for providing feedback and helping in improving this KIP. We have done a very thorough discussion on this KIP and I feel it's now ready for the voting process. Thanks and regards, Vedarth On Tue, 14 May 2024 at 20:43, Chris Egerton wrote: > Hi Vedarth, > > This looks great, thank you

[VOTE] KIP-950: Tiered Storage Disablement

2024-05-14 Thread Christo Lolov
Heya! I would like to start a vote on KIP-950: Tiered Storage Disablement in order to catch the last Kafka release targeting Zookeeper - https://cwiki.apache.org/confluence/display/KAFKA/KIP-950%3A++Tiered+Storage+Disablement Best, Christo

[VOTE] KIP-989: RocksDB Iterator Metrics

2024-05-14 Thread Nick Telford
Hi everyone, I'd like to call a vote on the Kafka Streams KIP-989: RocksDB Iterator Metrics: https://cwiki.apache.org/confluence/display/KAFKA/KIP-989%3A+RocksDB+Iterator+Metrics All of the points in the discussion thread have now been addressed. Regards, Nick

Re: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

2024-05-14 Thread Chris Egerton
Hi Vedarth, This looks great, thank you for helping me thoroughly understand the motivation and benefits for the KIP. Looks good to me. Regarding public interface for the images--everything in the "Public Interface" section in KIP-975 does qualify as public interface for the images IMO, but I

Community over Code EU 2024: The countdown has started!

2024-05-14 Thread Ryan Skraba
[Note: You're receiving this email because you are subscribed to one or more project dev@ mailing lists at the Apache Software Foundation.] We are very close to Community Over Code EU -- check out the amazing program and the special discounts that we have for you. Special discounts You still

[jira] [Resolved] (KAFKA-13115) doSend can be blocking

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-13115. Resolution: Fixed > doSend can be blocking >

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-05-14 Thread Chris Egerton
Hi Alieh, Thank you for all the updates! One final question--how will the retry timeout for unknown topic partition errors be implemented? I think it would be best if this could be done with an implementation of the error handler, but I don't see a way to track the necessary information with the

Re: [VOTE] KIP-932: Queues for Kafka

2024-05-14 Thread Andrew Schofield
Hi, I have made a small update to the KIP as a result of testing the new share consumer with client telemetry (KIP-714). I’ve added telemetry metric names to the table of client metrics and also updated the metric group names so that the resulting client metrics sent to the broker have consistent

[jira] [Created] (KAFKA-16761) ZkClusterInstance#start does not create ClusterConfigurableIntegrationHarness

2024-05-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16761: -- Summary: ZkClusterInstance#start does not create ClusterConfigurableIntegrationHarness Key: KAFKA-16761 URL: https://issues.apache.org/jira/browse/KAFKA-16761

Re: [VOTE] KIP-1038: Add Custom Error Handler to Producer

2024-05-14 Thread Andrew Schofield
Hi Alieh, Thanks for the KIP. +1 (non-binding) Andrew > On 7 May 2024, at 16:56, Alieh Saeedi wrote: > > Hi all, > > It seems that we have no more comments, discussions, or feedback on > KIP-1038; therefore, I’d like to open voting for the KIP: Add Custom Error > Handler to Producer >

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-05-14 Thread Alieh Saeedi
Thanks Andrew. Done :) @Chris: I changed the config parameter type from boolean to integer, which defines the timeout for retrying. I thought reusing `max.block.ms` was not reasonable as you mentioned. So if the KIP looks good, let 's skip to the good part ;-) VOTING :) Bests, Alieh On

Re: [VOTE] KIP-1036: Extend RecordDeserializationException exception

2024-05-14 Thread Lucas Brutschy
Thanks for the KIP! +1 binding On Tue, May 14, 2024 at 2:44 PM Frédérik Rouleau wrote: > > Hi all, > > I will keep the vote open for a few more hours as I would like to propose > the KIP for the next 3.8.0 release (deadline is the 15th May). > Currently we have +4 binding and +3 non-binding. >

Re: [VOTE] KIP-1036: Extend RecordDeserializationException exception

2024-05-14 Thread Frédérik Rouleau
Hi all, I will keep the vote open for a few more hours as I would like to propose the KIP for the next 3.8.0 release (deadline is the 15th May). Currently we have +4 binding and +3 non-binding. Thanks,

Re: [VOTE] KIP-1036: Extend RecordDeserializationException exception

2024-05-14 Thread Bruno Cadonna
Thanks! +1 (binding) Best, Bruno On 5/13/24 8:38 PM, Kirk True wrote: +1 (non-binding) Thanks Fred! On May 13, 2024, at 5:46 AM, Bill Bejeck wrote: Thanks for the KIP! +1 (binding) -Bill On Tue, May 7, 2024 at 6:16 PM Sophie Blee-Goldman wrote: +1 (binding) thanks for the KIP!

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-05-14 Thread Andrew Schofield
Hi Alieh, Just one final comment. [AJS5] Existing classes use Retriable, not Retryable. For example: https://kafka.apache.org/21/javadoc/org/apache/kafka/common/errors/RetriableException.html I suggest RetriableResponse and NonRetriableResponse. Thanks, Andrew > On 13 May 2024, at 23:17, Alieh

[jira] [Created] (KAFKA-16760) alterReplicaLogDirs failed even if responded with none error

2024-05-14 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16760: - Summary: alterReplicaLogDirs failed even if responded with none error Key: KAFKA-16760 URL: https://issues.apache.org/jira/browse/KAFKA-16760 Project: Kafka

[jira] [Created] (KAFKA-16759) Invalid client telemetry transition on consumer close

2024-05-14 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-16759: Summary: Invalid client telemetry transition on consumer close Key: KAFKA-16759 URL: https://issues.apache.org/jira/browse/KAFKA-16759 Project: Kafka

[jira] [Resolved] (KAFKA-16694) Remove rack aware code in assignors temporarily due to performance

2024-05-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16694. - Fix Version/s: 3.8.0 Resolution: Fixed > Remove rack aware code in assignors temporarily