Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1605

See

Re: [VOTE] KIP-894: Use incrementalAlterConfigs API for syncing topic configurations

+1 (binding) from me. Thank you. Luke On Thu, Jan 26, 2023 at 11:24 PM Federico Valeri wrote: > +1 (non binding) > > Thanks. > > On Thu, Jan 26, 2023 at 2:30 PM Gantigmaa Selenge > wrote: > > > > Hi > > > > I'd like to call for a vote on KIP-894, which updates MirrorMaker to use > >

Re: [VOTE] KIP-903: Replicas with stale broker epoch should not be allowed to join the ISR

To Jason: 1. We can make the BrokerEpoch a tagged field. But I am not sure about your proposed metadata structure. In the BrokerState, do we need to store the BrokerId again? It would duplicate with ReplicaId. 2. Considering that the broker reboot data loss case is rare and Kraft is coming soon.

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1604

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.2 #98

See Changes: -- [...truncated 347884 lines...] [2023-02-21T17:28:59.141Z] Execution optimizations have been disabled for 3 invalid unit(s) of work during this build to ensure

Re: [VOTE] KIP-903: Replicas with stale broker epoch should not be allowed to join the ISR

Hi Calvin, Thanks for the improvement. 1. In the KIP, you suggest changing the Fetch request to "Rename the ReplicaId to BrokerId" and "Add a new Field BrokerEpoch". The Fetch RPC is used by replicas that are not brokers, for example controllers in KRaft. Can we keep the name "ReplicaId" and use

Re: [VOTE] KIP-900: KRaft kafka-storage.sh API additions to support SCRAM for Kafka Brokers

LGTM Proven. Thanks for the improvements. +1 (binding) -- -José

Re: [DISCUSS] KIP-900: KRaft kafka-storage.sh API additions to support SCRAM

Hi Proven, On Tue, Feb 21, 2023 at 1:37 PM Proven Provenzano wrote: > > Hi Jose, > > 1. The SCRAM in SCRAM-SHA-256 is required as the mechanism name is > SCRAM-SHA-256. > I do realize there is a bit of redundancy here. > > 2. I'll add documentation for all the possible values. They are >

[jira] [Created] (KAFKA-14739) Kafka consumer reading messages out of order after a rebalance

Colin Shaw created KAFKA-14739: -- Summary: Kafka consumer reading messages out of order after a rebalance Key: KAFKA-14739 URL: https://issues.apache.org/jira/browse/KAFKA-14739 Project: Kafka

Re: [DISCUSS] KIP-900: KRaft kafka-storage.sh API additions to support SCRAM

Hi Jose, 1. The SCRAM in SCRAM-SHA-256 is required as the mechanism name is SCRAM-SHA-256. I do realize there is a bit of redundancy here. 2. I'll add documentation for all the possible values. They are SCRAM-SHA-256 and SCRAM-SHA-512. 3. I'd like to keep it with a capital letter as it is a

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1603

See

Re: [VOTE] KIP-903: Replicas with stale broker epoch should not be allowed to join the ISR

Hi Calvin, thanks for the KIP! A couple questions below: - Would it make sense to make the broker epoch a tagged field inside the Fetch request? It is a little annoying to increase the size of consumer fetch requests for a field that they will not use. Perhaps we could factor out broker id and

Re: [REVIEW REQUEST] Adjust Kafka log format with ZK

Please, take a look at PR. I’m sure it’s a valuable change. Should I file a ticket? > 20 февр. 2023 г., в 23:43, Николай Ижиков написал(а): > > Hello. > > I investigate some production failure lately and found that current log > format for WA ZOOKEEPER-2985 [1] not aligned with ZK internal

[DISCUSS] KIP-907: Add Boolean Serde to public interface

Hello Everyone, I’d like to get a discussion going for KIP-907: https://cwiki.apache.org/confluence/display/KAFKA/KIP-907%3A+Add+Boolean+Serde+to+public+interface Which adds Boolean Serde to the public interface. The KIP contains the details how I want to do this and what internal code I need

Re: [ANNOUNCE] New committer: Lucas Bradstreet

Congratulations, Lucas! best, Colin On Thu, Feb 16, 2023, at 13:54, Jun Rao wrote: > Hi, Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Lucas > Bradstreet. > > Lucas has been a long time Kafka contributor since Oct. 2018. He has been > extremely valuable for

Re: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

Hi Yash, We'll probably want to make a few tweaks to the Javadocs for the new methods (I'm imagining that notes on compatibility with older versions will be required), but I believe what's proposed in the KIP is good enough to approve with the understanding that it may not exactly match what gets

Re: [VOTE] KIP-900: KRaft kafka-storage.sh API additions to support SCRAM for Kafka Brokers

Thanks, Proven. +1 (binding) best, Colin On Thu, Feb 16, 2023, at 07:23, Proven Provenzano wrote: > Hi, > > I'd like to start the vote on KIP-900: KRaft kafka-storage.sh API additions > to support SCRAM for Kafka Brokers. > > The KIP is here: KIP-900 >

Re: [DISCUSS] KIP-899: Allow clients to rebootstrap

Hi Ivan, I believe the logic you've linked is only applicable for the producer and consumer clients; the admin client does something different (see [1]). Either way, it'd be nice to have a definition of when re-bootstrapping would occur that doesn't rely on internal implementation details. What

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.3 #157

See

[jira] [Resolved] (KAFKA-14530) Check state updater more than once in process loops

[ https://issues.apache.org/jira/browse/KAFKA-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14530. - Fix Version/s: 3.5.0 Resolution: Fixed > Check state updater more than once in

Re: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

Hi Chris, > we might try to introduce a framework-level configuration > property to dictate which of the pre-transform and post-transform > topic partitions are used for the fallback call to the single-arg > variant if a task class has not overridden the multi-arg variant Thanks for the

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #142

See Changes: -- [...truncated 220376 lines...] [2023-02-21T17:03:08.543Z] > Task :metadata:testClasses UP-TO-DATE [2023-02-21T17:03:08.543Z] > Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #86

See Changes: -- [...truncated 262576 lines...] [2023-02-21T17:02:22.306Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 169 > KafkaZkClientTest >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1602

See Changes: -- [...truncated 535254 lines...] [2023-02-21T16:52:08.617Z] > Task :storage:api:testClasses UP-TO-DATE [2023-02-21T16:52:08.617Z] > Task

[jira] [Created] (KAFKA-14738) Topic disappears from kafka_topic.sh --list after modifying it with kafka_acl.sh

Gabriel Lukacs created KAFKA-14738: -- Summary: Topic disappears from kafka_topic.sh --list after modifying it with kafka_acl.sh Key: KAFKA-14738 URL: https://issues.apache.org/jira/browse/KAFKA-14738

[jira] [Created] (KAFKA-14737) Move kafka.utils.json to server-common

Mickael Maison created KAFKA-14737: -- Summary: Move kafka.utils.json to server-common Key: KAFKA-14737 URL: https://issues.apache.org/jira/browse/KAFKA-14737 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

Hi Yash, I think the use case for pre-transform TPO coordinates (and topic partition writers created/destroyed in close/open) tends to boil down to exactly-once semantics, where it's desirable to preserve the guarantees that Kafka provides (every record has a unique TPO trio, and records are

Re: Request permissions to contribute to Kafka

Thanks Chris! On 21 Feb 2023, 8:18 PM +0530, Chris Egerton , wrote: > Hi Chaitanya, > > You should be good to go. Happy KIPping! > > Cheers, > > Chris > > On Tue, Feb 21, 2023 at 9:33 AM Chaitanya Mukka > wrote: > > > Hi folks! > > > > I am Chaitanya Mukka. I would like to start contributing to

Re: Request permissions to contribute to Kafka

Hi Chaitanya, You should be good to go. Happy KIPping! Cheers, Chris On Tue, Feb 21, 2023 at 9:33 AM Chaitanya Mukka wrote: > Hi folks! > > I am Chaitanya Mukka. I would like to start contributing to Kafka. Can I > get permission to AK Jira and permissions to Confluence to create KIPs? > >

Re: [DISCUSS] KIP-894: Use incrementalAlterConfigs API for syncing topic configurations

Hi Tina, Great stuff, LGTM. Cheers, Chris On Mon, Feb 20, 2023 at 8:12 AM Gantigmaa Selenge wrote: > Hi Chris, > > I have fixed the nits you mentioned and tried to improve the flow a little > bit. > > Please let me know what you think :) . > > Thank you. > Regards, > Tina > > On Fri, Feb 17,

Re: [DISCUSS] KIP-905: Broker interceptors

Also, the KIP doesn't describe the client-side experience Is a producer only expected to get the new API error in the response when the interceptor fails unexpectedly ? It looks otherwise that it is expected that records may get skipped or mutated without the producer metadata response noting

Request permissions to contribute to Kafka

Hi folks! I am Chaitanya Mukka. I would like to start contributing to Kafka. Can I get permission to AK Jira and permissions to Confluence to create KIPs? Jira and Wiki ID: cmukka Thanks and Regards, Chaitanya Mukka

Re: [DISCUSS] KIP-905: Broker interceptors

Hi David thanks for the KIP. Two initial observations from me. I think the Rejected Alternatives section could compare your proposal to the prior art that you rightly mention initially. Also, the Java interface could extend Kafka's own Configurable. This allows an implementation to get hold of

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1601

See

Re: Request permissions to contribute to Kafka

Hi, I can't find your wiki ID. Have you created the account in the confluence system ? Luke On Tue, Feb 21, 2023 at 12:05 AM ze zhang wrote: > Hi, > I'd like to request permissions to contribute to Kafka to