Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #3

See

Re: [DISCUSS] Apache Kafka 3.4.0 release

Thanks everyone for the updates, that all sounds good. Divij: I pinged some of the relevant reviewers to give your PRs a final pass, but will leave it to their judgement from here as I'm not familiar with either. Everyone else: reminder that today is the official code freeze deadline, so please

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

Hi Mathias, I did save it. The changes are added under Public Interfaces (Pt#2 about enhancing KeyQueryMetadata with partitions method) and throwing IllegalArgumentException when StreamPartitioner#partitions method returns multiple partitions for just FK-join instead of the earlier decided

[jira] [Resolved] (KAFKA-14432) RocksDBStore relies on finalizers to not leak memory

[ https://issues.apache.org/jira/browse/KAFKA-14432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-14432. Resolution: Fixed > RocksDBStore relies on finalizers to not leak memory

[jira] [Created] (KAFKA-14454) KTableKTableForeignKeyInnerJoinCustomPartitionerIntegrationTest#shouldThrowIllegalArgumentExceptionWhenCustomPartionerReturnsMultiplePartitions passes when run individua

Sagar Rao created KAFKA-14454: - Summary: KTableKTableForeignKeyInnerJoinCustomPartitionerIntegrationTest#shouldThrowIllegalArgumentExceptionWhenCustomPartionerReturnsMultiplePartitions passes when run individually but not when is run as part of the

Re: [DISCUSS] KIP-889 Versioned State Stores

Thanks for the discussion, Bruno, Sagar, and Matthias! It seems we've reached consensus on almost all of the discussion points. I've updated the KIP with the following: 1) renamed "timestampTo" in `get(key, timestampTo)` to "asOfTimestamp" to clarify that this timestamp bound is inclusive, per

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hi Sophie, Thanks for taking a look at the MM2 issue. We've merged a (minimally-scoped) fix and backported it to the 3.4 branch; the issue should be resolved now. Cheers, Chris On Wed, Dec 7, 2022 at 3:12 PM Rajini Sivaram wrote: > Hi Sophie, > > I have merged PR #12954 for KIP-881 to 3.4

[jira] [Created] (KAFKA-14453) Flaky test suite MirrorConnectorsWithCustomForwardingAdminIntegrationTest

Chris Egerton created KAFKA-14453: - Summary: Flaky test suite MirrorConnectorsWithCustomForwardingAdminIntegrationTest Key: KAFKA-14453 URL: https://issues.apache.org/jira/browse/KAFKA-14453 Project:

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1414

See

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hi Sophie, I have merged PR #12954 for KIP-881 to 3.4 branch. Please let me know if that is ok. Thank you, Rajini On Wed, Dec 7, 2022 at 11:43 AM Rajini Sivaram wrote: > Hi Sophie, > > The first PR for KIP-881 which contains protocol changes has been merged > to trunk

Re: [VOTE] KIP-884: Add config to configure KafkaClientSupplier in Kafka Streams

Hi all, I updated the KIP to add a `getKafkaClientSupplier` method in `StreamsConfig`. Let me know if you have any concerns. Thanks, Hao On Wed, Nov 30, 2022 at 10:26 AM Hao Li wrote: > Hi all, > > Thanks for the vote. The vote passed with 4 binding votes (John, Matthias, > Sophie and Bruno).

[jira] [Created] (KAFKA-14452) Make sticky assignors rack-aware if consumer racks are configured.

Rajini Sivaram created KAFKA-14452: -- Summary: Make sticky assignors rack-aware if consumer racks are configured. Key: KAFKA-14452 URL: https://issues.apache.org/jira/browse/KAFKA-14452 Project:

[jira] [Created] (KAFKA-14451) Make range assignor rack-aware if consumer racks are configured

Rajini Sivaram created KAFKA-14451: -- Summary: Make range assignor rack-aware if consumer racks are configured Key: KAFKA-14451 URL: https://issues.apache.org/jira/browse/KAFKA-14451 Project: Kafka

[jira] [Created] (KAFKA-14450) Rack-aware partition assignment for consumers (KIP-881)

Rajini Sivaram created KAFKA-14450: -- Summary: Rack-aware partition assignment for consumers (KIP-881) Key: KAFKA-14450 URL: https://issues.apache.org/jira/browse/KAFKA-14450 Project: Kafka

Kafka logs issue

Hi Kafka Team, We are using Kafka in our project for consuming and producing, but we are continuous logs after starting the server. Could someone please help me on this issue. Thanks and Regards, Ashok

[jira] [Created] (KAFKA-14449) Brokers not re-joining the ISR list and stuck at started until all the brokers restart

Swathi Mocharla created KAFKA-14449: --- Summary: Brokers not re-joining the ISR list and stuck at started until all the brokers restart Key: KAFKA-14449 URL: https://issues.apache.org/jira/browse/KAFKA-14449

Re: [VOTE] KIP-878: Internal Topic Autoscaling for Kafka Streams

+1 (binding) On 12/1/22 9:39 PM, Sophie Blee-Goldman wrote: Thanks to all who participated for a great discussion on this KIP. Seems we're ready to kick off the voting on this, but please don't hesitate to call out anything of concern or raise questions over on the voting thread. Otherwise,

Re: [DISCUSS] KIP-878: Autoscaling for Statically Partitioned Streams

Thanks for the background. Was just curious about the details. I agree that we should not add a new backoff config at this point. -Matthias On 12/2/22 4:47 PM, Sophie Blee-Goldman wrote: I missed the default config values as they were put into comments... You don't read code comments?

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

I don't see any update on the wiki about it. Did you forget to hit "save"? Can you also provide some background? I am not sure right now if I understand the proposed changes? -Matthias On 12/6/22 6:36 PM, Sophie Blee-Goldman wrote: Thanks Sagar, this makes sense to me -- we clearly need

[jira] [Created] (KAFKA-14448) ZK brokers register with KRaft during migration

David Arthur created KAFKA-14448: Summary: ZK brokers register with KRaft during migration Key: KAFKA-14448 URL: https://issues.apache.org/jira/browse/KAFKA-14448 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14447) Controlled shutdown for ZK brokers during migration

David Arthur created KAFKA-14447: Summary: Controlled shutdown for ZK brokers during migration Key: KAFKA-14447 URL: https://issues.apache.org/jira/browse/KAFKA-14447 Project: Kafka Issue

Re: [DISCUSS] KIP-875: First-class offsets support in Kafka Connect

Hi Chris, Sorry for the late reply. > I don't believe logging an error message is sufficient for > handling failures to reset-after-delete. IMO it's highly > likely that users will either shoot themselves in the foot > by not reading the fine print and realizing that the offset > request may

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hi Sophie, The first PR for KIP-881 which contains protocol changes has been merged to trunk (https://github.com/apache/kafka/pull/12954). It is a relatively small PR, can we merge to 3.4.0? Thank you, Rajini On Wed, Dec 7, 2022 at 11:16 AM Divij Vaidya wrote: > Hey Sophie > > I have a

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hey Sophie I have a couple of pending PRs which have been waiting for review since preparation of the 3.3 release. They are not blockers for 3.4 but are being tracked as improvements that we would like to add to 3.4 release. Please consider taking a look when you get a chance: 1.

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

The method is needed for RLMM implementations which fetch the information over the network and not for the disk based implementations (such as the default topic based RLMM). I would argue that adding this API makes the interface more generic than what it is today. This is because, with the