Re: Re: [DISCUSS] KIP-195: AdminClient.increasePartitions

Selvamalar, It's a self service. Please send a mail to ` dev-unsubscr...@kafka.apache.org` and `users-unsubscr...@kafka.apache.org` to unsubscribe from the `dev On Fri, Sep 8, 2017 at 10:02 PM, Selvamalar Arunkumar < selvamalar.arunku...@walmart.com> wrote: > Please remove my email id from

Re: [VOTE] KIP-289: Improve the default group id behavior in KafkaConsumer

+1 (non-binding) Thanks for the KIP. On Wed, Aug 8, 2018 at 3:11 PM Stanislav Kozlovski wrote: > +1 (non-binding) > Thanks! > > On Tue, Aug 7, 2018 at 11:47 PM Jason Gustafson > wrote: > > > +1 Thanks Vahid. > > > > On Tue, Aug 7, 2018 at 11:14 AM, Vahid S Hashemian < > >

Re: [VOTE] KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer

+1 Thanks for the KIP! On Wed, Aug 22, 2018 at 2:48 PM Viktor Somogyi-Vass wrote: > Hi All, > > I'd like to start a vote on this KIP ( > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=87298242) > which aims to refactor ExtendedSerializer/Serializer and >

Re: [VOTE] KIP-338 Support to exclude the internal topics in kafka-topics.sh command

Chia-Ping Tsai, The voting has passed. Dong Lin (binding) is a committer. On Wed, Jul 25, 2018 at 8:24 AM Chia-Ping Tsai wrote: > Current voting result is shown below. > > +2 (binding) > 1) Jason Gustafson > 2) Gwen Shapira > > +4 (non-binding) > 1) Colin McCabe > 2) Manikumar > 3) Dong Lin >

Re: [VOTE] KIP-322: Return new error code for DeleteTopics API when topic deletion disabled.

+1 (non-binding) On Wed, Jul 4, 2018 at 5:22 PM Magnus Edenhill wrote: > +1 (non-binding) > > 2018-07-04 13:40 GMT+02:00 Satish Duggana : > > > +1 > > > > Thanks, > > Satish. > > > > On Wed, Jul 4, 2018 at 4:11 PM, Daniele Ascione > > wrote: > > > > > +1 > > > > > > Thanks, > > > Daniele > > >

Re: [ANNOUNCE] New Committer: Manikumar Reddy

Congratulations, Manikumar! On Thu, 11 Oct 2018, 23:29 Rajini Sivaram, wrote: > Congratulations, Manikumar! > > On Thu, Oct 11, 2018 at 6:57 PM Suman B N wrote: > > > Congratulations Manikumar! > > > > On Thu, Oct 11, 2018 at 11:09 PM Jason Gustafson > > wrote: > > > > > Hi all, > > > > > >

Re: Re run build of a pull request

No need to push a commit to run the test case. Type "retest this please" as comment. It will again run all the test cases. On Wed, Oct 3, 2018 at 1:12 PM Suman B N wrote: > Team, > > Every once in a while, PR builds fails due to below test failure with Null > Pointer Exception. > >-

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin! On Tue, Sep 25, 2018 at 7:42 PM Dhruvil Shah wrote: > Congratulations Colin! > > On Tue, Sep 25, 2018 at 6:47 AM Stephane Maarek < > steph...@simplemachines.com.au> wrote: > > > Congrats Colin ! > > > > On Tue., 25 Sep. 2018, 3:33 pm Bill Bejeck, wrote: > > > > >

Re: [DISCUSS] KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions

l know which topic is affected > and can provide a corresponding implementation. Was just wondering if we > should be more strict? > > > -Matthias > > On 12/6/18 10:01 AM, Kamal Chandraprakash wrote: > > Matt, > > I agree with Matthias on not to altering

Request for wiki permission to create KIP

Hi, I would like to propose a KIP for KAFKA-7499 . Please grant me permission to create KIP. ID: ckamal

[DISCUSS] KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions

https://issues.apache.org/jira/browse/KAFKA-7499 All feedbacks will be highly appreciated. Thanks, Kamal Chandraprakash

Re: [DISCUSS] KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions

-intended results. On Wed, Dec 5, 2018 at 8:41 PM Matt Farmer wrote: > Hi there, > > Thanks for this KIP. > > What’s the thinking behind doing this in ProductionExceptionHandler versus > handling these cases in your serializer implementation? > > On Mon, Dec 3, 2018 at 1:09

Re: [DISCUSS] KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions

one? > > > > -Matthias > > On 12/6/18 8:35 AM, Matt Farmer wrote: > > Ah, good point. > > > > Should we consider altering the serializer interface to permit not > sending > > the record? > > > > On Wed, Dec 5, 2018 at 9:23 PM Kamal Chandrapraka

Re: [ANNOUNCE] New Committer: Bill Bejeck

Congratulations Bill! On Thu, Feb 14, 2019 at 3:55 PM Ivan Ponomarev wrote: > Congratulations, Bill! > > Your 'Kafka Streams in Action' is a great book. These months it is > always travelling with me in my backpack with my laptop )) > > Regards, > > Ivan > > 14.02.2019 3:56, Guozhang Wang

Re: Contributor Apply

nit: You can *now* self-assign tickets. On Fri, May 24, 2019 at 11:30 PM Matthias J. Sax wrote: > Added you to the list on contributors. You can not self-assign tickets. > > Please read > https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes > to get started. > > > >

Re: [VOTE] 2.3.0 RC3

+1 (non-binding) * Ran unit and integration test on 2.11 and 2.12 * Verified quick start * Ran internal apps on the 3 node cluster On Thu, Jun 20, 2019 at 3:33 AM Colin McCabe wrote: > Hi all, > > We discovered some problems with the second release candidate (RC2) of > 2.3.0. Specifically,

Re: [DISCUSS] KIP-467: Augment ProduceResponse error messaging

This KIP is inline with KIP-334 in which it's proposed that the consumer will throw FaultyRecordException with corrupt/in-operative record offset and topic-partition on encountering the invalid record. In this KIP

Re: [VOTE] KIP-434: Dead replica fetcher and log cleaner metrics

+1 (non-binding). Thanks for the KIP! On Thu, Jun 6, 2019 at 8:12 PM Andrew Schofield wrote: > +1 (non-binding) > > Andrew > > On 06/06/2019, 15:15, "Ryanne Dolan" wrote: > > +1 (non-binding) > > Thanks > Ryanne > > On Wed, Jun 5, 2019, 9:31 PM Satish Duggana > wrote: > >

Re: [VOTE] KIP-440: Extend Connect Converter to support headers

+1 (non-binding). Thanks for the KIP! On Sun, May 19, 2019 at 6:36 PM Dongjin Lee wrote: > +1 (non-binding). > > Binding: +2 (Randall, Gwen) > Non-binding: +2 (Andrew, Dongjin) > > We need one more +1 from the committers. Is there anyone else? > > Thanks, > Dongjin > > On Fri, May 10, 2019 at

Re: [VOTE] KIP-453: Add close() method to RocksDBConfigSetter

+1 (non-binding). Thanks for the KIP. On Tue, May 7, 2019 at 3:50 AM Bill Bejeck wrote: > Thanks for the KIP Sophie. > > +1(binding) > > On Mon, May 6, 2019 at 4:51 PM John Roesler wrote: > > > Thanks, Sophie, I reviewed the KIP, and I agree this is the best / > > only-practical approach. > >

Re: [VOTE] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

this discussion? I think we can have a single exception type FaultyRecordException/RecordDeserialization exception to capture both the errors. We can add an additional enum field to differentiate the errors if required. Thanks, Kamal Chandraprakash On Wed, Apr 24, 2019 at 1:49 PM Kamal

Re: [VOTE] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

Stanislav, Any updates on this KIP? We have internal users who want to skip the corrupted message while consuming the records. On Fri, Oct 19, 2018 at 11:34 PM Matthias J. Sax wrote: > I am not 100% familiar with the details of the consumer code, however I > tend to disagree with: > > >

Re: [VOTE] KIP-520: Augment Consumer.committed(partition) to allow multiple partitions

Thanks for the KIP! LGTM, +1 (non-binding). On Wed, Sep 11, 2019 at 3:23 AM Matthias J. Sax wrote: > I don't have a strong preference. So I am also fine to deprecate the > existing methods. Let's see what Jason thinks. > > Can you update the KIP to reflect the semantics of the return `Map`

Re: [DISCUSS] KIP-490: log when consumer groups lose a message because offset has been deleted

Jose, How do you differentiate the compaction topics from the time retention topics? Deleting a message due to compaction policy is a valid case and users won't be interested in monitoring/reading those deleted messages. Thanks, Kamal On Tue, Jul 23, 2019 at 4:00 AM Jose M wrote: > Hi

Re: [ANNOUNCE] New committer: Mickael Maison

Congrats Mickael! On Sat, Nov 9, 2019 at 4:47 AM Sean Glover wrote: > Congratulations Mickael :) > > On Fri, Nov 8, 2019 at 12:28 PM Ankit Kumar > wrote: > > > Congratulations Mickael!! > > > > *Best regards,* > > *Ankit Kumar.* > > > > > > On Fri, Nov 8, 2019 at 9:08 PM Viktor Somogyi-Vass <

Re: [ANNOUNCE] New committer: John Roesler

Congrats John! On Wed, Nov 13, 2019 at 7:57 AM Dong Lin wrote: > Congratulations John! > > On Tue, Nov 12, 2019 at 1:56 PM Guozhang Wang wrote: > > > Hi Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer, > John > > Roesler. > > > > John has been

Re: [VOTE] KIP-525 - Return topic metadata and configs in CreateTopics response

+1 (non-binding), Thanks for the KIP! On Mon, Sep 23, 2019 at 10:45 AM Satish Duggana wrote: > Thanks for the KIP, +1 (non binding) > > This looks to be a useful API for admin tools. When we worked on an > admin tool for Kafka, we had to explicitly call the config API for > showing the configs

Re: [VOTE] KIP-409: Allow creating under-replicated topics and partitions

+1 (non-binding). Thanks for the KIP! On Mon, Jan 13, 2020 at 1:58 PM M. Manna wrote: > Hi Mikael, > > Apologies for last minute question, as I just caught up with it. Thanks for > your work on the KIP. > > Just trying to get your thoughts on one thing (I might have misunderstood > it) -

Re: [VOTE] KIP-574: CLI Dynamic Configuration with file input

+1 (non-binding). Thanks for the KIP! On Fri, Mar 27, 2020 at 9:16 PM Gwen Shapira wrote: > Vote is still good. We can always add things later if needed. > > On Fri, Mar 27, 2020, 8:15 AM Aneel Nazareth wrote: > > > Hi Colin and Gwen, > > > > I wanted to double-check that your +1 votes were

Re: [DISCUSS] KIP-574: CLI Dynamic Configuration with file input

STDIN wasn't standard practice in other scripts like kafka-console-consumer.sh, kafka-console-producer.sh and kafka-acls.sh in which the props file is accepted via consumer.config / producer.config / command-config parameter. Shouldn't we have to maintain the uniformity across scripts? On Mon,

Re: [DISCUSS] KIP-574: CLI Dynamic Configuration with file input

gt; feelings. > > > > I think the ideal solution would be to support "-" in these tools > whenever > > a file argument was expected. But that would be a bigger change than > what > > we're talking about here. Maybe you are right and we should keep it >

Re: [DISCUSS] KIP-581: add tag "partition" to BrokerTopicMetrics so as to observe the partition metrics on the same broker

https://issues.apache.org/jira/browse/KAFKA-7219 is identical to this one. On Tue, Mar 24, 2020 at 10:15 AM Xue LIU wrote: > Hi Chai-Ping, > > Thank you for bringing up this proposal. My team also has the need to have > per partition metrics on traffic, which would be used by our partition >

Re: [VOTE] KIP-580: Exponential Backoff for Kafka Clients

+1 (non-binding). Thanks for the KIP! On Mon, Mar 23, 2020 at 11:20 PM Sanjana Kaundinya wrote: > Hi Everyone, > > I’d like to start a vote for KIP-580: Exponential Backoff for Kafka > Clients. The link to the KIP can be found here: >

Re: [VOTE] KIP-635: GetOffsetShell: support for multiple topics and consumer configuration override

+1 (non-binding), thanks for the KIP! On Thu, Jul 30, 2020 at 3:31 PM Manikumar wrote: > +1 (binding) > > Thanks for the KIP! > > > > On Thu, Jul 30, 2020 at 3:07 PM Dániel Urbán > wrote: > > > Hi everyone, > > > > If you are interested in this KIP, please do not forget to vote. > > > >

Re: [DISCUSS] KIP-760: Increase minimum value of segment.ms and segment.bytes

Badai, Thanks for the KIP! This is useful to avoid crashes in production scenarios. If someone still wants to quickly roll the log segments in test env, then they can do it by configuring the index.interval.bytes and segment.index.bytes to low value to force the log roll. -- Kamal On Thu,

Re: [VOTE] KIP-717: Deprecate batch-size config from console producer

ve the config option as the config option is unused. > > > > > > On Wed, Mar 10, 2021 at 3:06 PM Kamal Chandraprakash < > > > kamal.chandraprak...@gmail.com> wrote: > > > > > > > Hi, > > > > > > > > I'd like to

[VOTE] KIP-717: Deprecate batch-size config from console producer

Hi, I'd like to start a vote on KIP-717 to remove batch-size config from the console producer. https://cwiki.apache.org/confluence/x/DB1RCg Thanks, Kamal

Re: [ANNOUNCE] New Kafka PMC Member: Chia-Ping Tsai

Congratulations, Chia-Ping!! On Sat, Mar 13, 2021 at 11:38 AM Ismael Juma wrote: > Congratulations Chia-Ping! Well deserved. > > Ismael > > On Fri, Mar 12, 2021, 11:14 AM Jun Rao wrote: > > > Hi, Everyone, > > > > Chia-Ping Tsai has been a Kafka committer since Oct. 15, 2020. He has > been >

Re: [ANNOUNCE] New committer: Tom Bentley

Congrats, Tom! On Tue, Mar 16, 2021 at 8:32 AM Konstantine Karantasis wrote: > Congratulations Tom! > Well deserved. > > Konstantine > > On Mon, Mar 15, 2021 at 4:52 PM Luke Chen wrote: > > > Congratulations! > > > > Federico Valeri 於 2021年3月16日 週二 上午4:11 寫道： > > > > > Congrats, Tom! > > > >

Re: [DISCUSS] KIP-717: Deprecate batch-size config from console producer

This is a minor and straight-forward KIP. If there are no objections, I'll raise a VOTE thread. On Mon, Mar 1, 2021 at 6:03 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Hi, > > Please take a look at KIP-717. Request for your comments. > > https://cwiki.

[DISCUSS] KIP-717: Deprecate batch-size config from console producer

Hi, Please take a look at KIP-717. Request for your comments. https://cwiki.apache.org/confluence/x/DB1RCg Thanks, Kamal

Re: [VOTE] KIP - 405: Kafka Tiered Storage.

+1 (non-binding) On Tue, Feb 16, 2021 at 11:22 AM Ivan Yurchenko wrote: > Hi, > > Great! > +1 (non-binding) > > Best, > Ivan > > On Mon, 15 Feb 2021 at 22:47, Kowshik Prakasam wrote: > > > +1 (non-binding). Thanks for the excellent KIP! > > > > > > Cheers, > > Kowshik > > > > > > > > > > > >

Re: [VOTE] KIP-717: Deprecate batch-size config from console producer

Bringing up this minor KIP. The batch-size option is unused in the console producer. We should either remove or deprecate it. PR: https://github.com/apache/kafka/pull/10202/ On Fri, Apr 30, 2021 at 5:32 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Bumping up th

Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

Congratulations Satish! On Fri, Oct 27, 2023, 21:10 Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Congratulations Satish!! > > On Fri, 27 Oct 2023 at 18:38, Mickael Maison > wrote: > > > Congratulations Satish! > > > > On Fri, Oct 27, 2023 at 5:18 PM Lucas Brutschy > >

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

t 2023 at 10:49, Gantigmaa Selenge < > > gsele...@redhat.com> > > > > > wrote: > > > > > > > > > >> Hi Christo, > > > > >> > > > > >> Thank you for writing the KIP. > > > > >> > &

Re: [ANNOUNCE] New Kafka PMC Member: Justine Olshan

Congrats Justine! On Sat, Sep 23, 2023, 13:28 Divij Vaidya wrote: > Congratulations Justine! > > On Sat 23. Sep 2023 at 07:06, Chris Egerton > wrote: > > > Congrats Justine! > > On Fri, Sep 22, 2023, 20:47 Guozhang Wang > > wrote: > > > > > Congratulations! > > > > > > On Fri, Sep 22, 2023 at

Re: [ANNOUNCE] New committer: Yash Mayya

Congratulations Yash! On Thu, Sep 21, 2023, 22:03 Bill Bejeck wrote: > Congrats Yash! > > On Thu, Sep 21, 2023 at 12:26 PM Divij Vaidya > wrote: > > > Congratulations Yash! > > > > Divij Vaidya > > > > > > On Thu, Sep 21, 2023 at 6:18 PM Sagar wrote: > > > > > > Congrats Yash ! > > > On Thu,

Re: [ANNOUNCE] New committer: Lucas Brutschy

Congrats Lucas! On Thu, Sep 21, 2023, 22:05 Boudjelda Mohamed Said wrote: > Congratulations, Lucas!! > > On Thu 21 Sep 2023 at 18:34, Lianet M. wrote: > > > Congratulations Lucas! > > > > On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna > > wrote: > > > > > Hi all, > > > > > > The PMC of

Re: [DISCUSS] KIP-979: Allow independently stop KRaft controllers or brokers

Hi Hailey, Thanks for working on this! This is one of the long-standing open issues. Now, users have to find the PID of the respective Kafka process to stop if more than one node is being run locally for testing purposes. The updated KIP is addressing that. LGTM. Is `node.id` and `broker.id` the

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

+1 (non-binding). Thanks for the KIP! On Mon, Oct 23, 2023, 12:55 Hailey Ni wrote: > Hi all, > > I'd like to call a vote on KIP-979 that will allow users to independently > stop KRaft processes. > > >

Re: [DISCUSS] KIP-972: Add the metric of the current running version of kafka

Hi Hudeqi, Kafka already emits the version metric. Can you check whether the below metric satisfies your requirement? kafka.server:type=app-info,id=0 -- Kamal On Mon, Aug 28, 2023 at 2:29 PM hudeqi <16120...@bjtu.edu.cn> wrote: > Hi, all, I want to submit a minor kip to add a metric, which

Re: [ANNOUNCE] New committer: Satish Duggana

Congratulations Satish! On Sat, Dec 24, 2022 at 7:53 PM Israel Ekpo wrote: > Congratulations Satish. Well deserved! > > On Sat, Dec 24, 2022 at 6:57 AM Yash Mayya wrote: > > > Congratulations Satish! > > > > On Fri, Dec 23, 2022, 23:38 Jun Rao wrote: > > > > > Hi, Everyone, > > > > > > The

Re: [VOTE] KIP-917: Additional custom metadata for remote log segment

+1 (non-binding). Thanks for the KIP! On Mon, Jun 12, 2023, 21:23 Divij Vaidya wrote: > I have reviewed the proposal and feel that it would be beneficial to > implement. > > Vote +1 (non-binding) > > > -- > Divij Vaidya > > > > On Mon, Jun 12, 2023 at 4:39 PM Ivan Yurchenko > wrote: > > >

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

Hi Divij, Thanks for the KIP! Sorry for the late reply. Can you explain the rejected alternative-3? Store the cumulative size of remote tier log in-memory at RemoteLogManager "*Cons*: Every time a broker starts-up, it will scan through all the segments in the remote tier to initialise the

Re: [ANNOUNCE] Apache Kafka 3.4.1

Thanks Luke for running this release! On Wed, Jun 7, 2023 at 8:08 AM Chia-Ping Tsai wrote: > Thank Luke for this hard work!!! > > > Chris Egerton 於 2023年6月7日 上午10:35 寫道： > > > > Thanks for running this release, Luke! > > > > On Tue, Jun 6, 2023, 22:31 Luke Chen wrote: > > > >> The Apache

Re: [VOTE] KIP-872: Add Serializer#serializeToByteBuffer() to reduce memory copying

+1 (non-binding). Thanks for the improvement! Thanks, Kamal On Wed, May 31, 2023 at 8:23 AM ziming deng wrote: > Hello ShunKang, > > +1(binding) from me > > -- > Thanks, > Ziming > > > On May 30, 2023, at 20:07, ShunKang Lin > wrote: > > > > Hi all, > > > > Bump this thread again and see if

Re: [ANNOUNCE] Apache Kafka 3.5.1

Thanks for running the release, Divij! On Mon, Jul 24, 2023 at 3:17 PM Divij Vaidya wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 3.5.1 > > This release is a security patch release. It upgrades the dependency, > snappy-java, to a version which is not

Re: [VOTE] KIP-959 Add BooleanConverter to Kafka Connect

+1 (non-binding). Thanks for the KIP! On Tue, Jul 25, 2023 at 11:12 PM Yash Mayya wrote: > Hi Hector, > > Thanks for the KIP! > > +1 (non-binding) > > Thanks, > Yash > > On Tue, Jul 25, 2023 at 11:01 PM Andrew Schofield < > andrew_schofield_j...@outlook.com> wrote: > > > Thanks for the KIP. As

Re: [DISCUSS] KIP-930: Tiered Storage Metrics

Hi Abhijeet, Thanks for the KIP! We are changing the metric names from what was proposed in the KIP-405 and adding new metrics for RemoteIndexCache. In the KIP, it's not clear whether we are renaming the aggregate broker level metrics for remote copy/fetch/failed-copy/failed-fetch. Are these

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

Hi Christo, Thanks for the KIP! The proposed tiered storage metrics are useful. The unit mentioned in the KIP is the number of records. Each topic can have varying amounts of records in a segment depending on the record size. Do you think having the tier-lag by number of segments (or) size of

Re: [VOTE] KIP-930: Tiered Storage Metrics

+1 (non-binding) -- Kamal On Tue, Jul 25, 2023 at 11:30 AM Abhijeet Kumar wrote: > Hi All, > > I would like to start the vote for KIP-930 Tiered Storage Metrics. > > The KIP is here: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Tiered+Storage+Metrics > > Regards > Abhijeet.

Re: [ANNOUNCE] New committer: Divij Vaidya

Congratulations, Divij!! On Wed, Jun 14, 2023, 19:49 Chris Egerton wrote: > Congrats, Divij! > > On Wed, Jun 14, 2023 at 9:06 AM Edoardo Comar > wrote: > > > Congratulations Divij ! > > > > > > On Wed, 14 Jun 2023 at 10:51, Josep Prat > > wrote: > > > > > Congrats Divij! > > > > > > On Wed,

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

> > The disadvantage of adding this new API is that every provider will > have to > > > implement it, agreed. But I believe that this tradeoff is worthwhile > since > > > the default implementation could be the same as you mentioned, i.e. > keeping > > > cumul

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Andrew, Thank you for the KIP -- interesting read. I have some questions: 101. "The calls to KafkaConsumer.acknowledge(ConsumerRecord, AcknowledgeType) must be issued in the order in which the records appear in the ConsumerRecords object, which will be in order of increasing offset for each

Re: [VOTE] KIP-852: Optimize calculation of size for log in remote tier

+1 (non-binding). Thanks for the KIP! — Kamal On Mon, 7 Nov 2022 at 2:20 AM, John Roesler wrote: > Hi Divij, > > Thanks for the KIP! > > I’ve read through your write-up, and it sounds reasonable to me. > > I’m +1 (binding) > > Thanks, > John > > On Tue, Nov 1, 2022, at 05:03, Divij Vaidya

Re: [DISCUSS] KIP-926: introducing acks=min.insync.replicas config

Hi, Inline with the *backup-only* replica approach, KIP-491: Preferred Leader Deprioritized List was proposed to mark a replica as the lowest priority to become leader. On Sat, May 13, 2023 at 6:53 AM 67 wrote: >

Re: [VOTE] KIP-927: Improve the kafka-metadata-quorum output

+1 (non binding) On Wed, May 17, 2023 at 3:22 AM Divij Vaidya wrote: > +1 (non binding) > > Divij Vaidya > > > > On Tue, May 16, 2023 at 4:35 AM ziming deng > wrote: > > > Thanks for this improvement, +1 from me(binging) > > > > — > > Best, > > Ziming > > > > > On May 16, 2023, at 00:43,

[VOTE] KIP-1007: Introduce Remote Storage Not Ready Exception

Hi, I would like to call a vote for KIP-1007 . This KIP aims to introduce a new error code for retriable remote storage errors. Thanks to everyone who reviewed the KIP! -- Kamal

Re: [DISCUSS] KIP-1007: Introduce Remote Storage Not Ready Exception

Thanks Luke for reviewing this KIP! If there are no more comments from others, I'll start the VOTE since this is a minor KIP. On Mon, Dec 11, 2023 at 1:01 PM Luke Chen wrote: > Hi Kamal, > > Thanks for the KIP! > LGTM. > > Thanks. > Luke > > On Wed, Nov 22, 2023 at 7

Re: [VOTE] KIP-1005: Expose EarliestLocalOffset and TieredOffset

+1 (non-binding). Thanks for the KIP! -- Kamal On Thu, Dec 21, 2023 at 2:23 PM Christo Lolov wrote: > Heya all! > > KIP-1005 ( > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1005%3A+Expose+EarliestLocalOffset+and+TieredOffset > ) > has been open for around a month with no further

Re: [DISCUSS] KIP-1007: Introduce Remote Storage Not Ready Exception

t; > [1] > > https://github.com/apache/kafka/blob/82808873cbf6a95611243c2e7984c4aa6ff2cfff/core/src/main/scala/kafka/log/UnifiedLog.scala#L1336 > > > -- > Divij Vaidya > > > > On Tue, Dec 12, 2023 at 9:58 AM Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > Thanks

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

Hi Ziming, Thanks for the KIP! The proposal LGTM. I'm also inclined towards option 2 (i.e. add an explicit --enable-incremental flag in 3.X version) to avoid any incompatible change in v3.X. As mentioned in this thread, many users might be using external tools to do the topic rebalance and apply

Re: [ANNOUNCE] New Kafka PMC Member: Divij Vaidya

Congrats Divij! On Thu, Dec 28, 2023, 07:09 Kirk True wrote: > Congrats Divij!!! > > On Wed, Dec 27, 2023, at 1:44 PM, Jorge Esteban Quilcate Otoya wrote: > > Congratulations Divij!! > > > > On Wed 27. Dec 2023 at 14.56, Tom Bentley wrote: > > > > > Congratulations! > > > > > > On Thu, 28 Dec

Re: [VOTE] KIP-1013: Drop broker and tools support for Java 11 in Kafka 4.0 (deprecate in 3.7)

+1 (non-binding). On Wed, Jan 3, 2024 at 8:01 AM Satish Duggana wrote: > Thanks Ismael for the proposal. > > Adopting JDK 17 enhances developer productivity and has reached a > level of maturity that has led to its adoption by several other major > projects, signifying its reliability and

Re: [VOTE] KIP-1007: Introduce Remote Storage Not Ready Exception

will be a more explicit > > > > behaviour than what Kafka does today - I am happy with it! > > > > > > > > +1 (non-binding) from me > > > > > > > > Best, > > > > Christo > > > > > > > > On Tue, 12

Re: [VOTE] 3.6.1 RC0

+1 (non-binding) 1. Built the source from 3.6.1-rc0 tag in scala 2.12 and 2.13 2. Ran all the unit and integration tests. 3. Ran quickstart and verified the produce-consume on a 3 node cluster. 4. Verified the tiered storage functionality with local-tiered storage. On Tue, Nov 28, 2023 at 12:55 

Re: [DISCUSS] KIP-1018: Introduce max remote fetch timeout config

jira/browse/KAFKA-15776 > [2] https://github.com/apache/kafka/pull/14778#issuecomment-1820588080 > > On Tue, 30 Jan 2024 at 01:01, Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > Hi all, > > > > I have opened a KIP-1018 > > < > &

Re: [VOTE] KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

+1 (non-binding) On Mon, Jan 22, 2024 at 8:34 AM ziming deng wrote: > Hello everyone, > I'd like to initiate a vote for KIP-1011. > This KIP is about replacing alterConfigs with incrementalAlterConfigs when > updating broker configs using kafka-configs.sh, this is similar to what we > have done

[DISCUSS] KIP-1018: Introduce max remote fetch timeout config

Hi all, I have opened a KIP-1018 to introduce dynamic max-remote-fetch-timeout broker config to give more control to the operator.

Re: [VOTE] KIP-997: Partition-Level Throughput Metrics

+1 (non-binding). Thanks for the KIP! On Thu, Nov 16, 2023 at 9:00 AM Satish Duggana wrote: > Thanks Qichao for the KIP. > > +1 (binding) > > ~Satish. > > On Thu, 16 Nov 2023 at 02:20, Jorge Esteban Quilcate Otoya > wrote: > > > > Qichao, thanks again for leading this proposal! > > > > +1

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

Hi Christo, Thanks for the KIP! Similar to the earliest-local-log offset, can we also expose the highest-copied-remote-offset via GetOffsetShell tool? This will be useful during the debugging session. On Mon, Nov 20, 2023 at 5:38 PM Christo Lolov wrote: > Hello all! > > I would like to start

Re: RemoteStorageManager.fetchLogSegment - how to deal with InterruptedException?

Hi Ivan, I've opened a relevant patch to increase the timeout to fetch data from remote storage. This will reduce the error occurrence rate: https://github.com/apache/kafka/pull/14778 I think it's better to distinguish the cases: 1) Any error that happens while reading the remote data -- this

Re: [VOTE] KIP-963: Additional metrics in Tiered Storage

+1 (non-binding). Thanks for the KIP! On Tue, Nov 21, 2023, 03:04 Divij Vaidya wrote: > + 1 (binding) > > This Kip will greatly improve Tiered Storage troubleshooting. Thank you > Christo. > > On Mon 20. Nov 2023 at 17:21, Christo Lolov > wrote: > > > Hello all! > > > > Now that the discussion

[DISCUSS] KIP-1007: Introduce Remote Storage Not Ready Exception

Hi, I would like to start a discussion to introduce a new error code for retriable remote storage errors. Please take a look at the proposal: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1007%3A+Introduce+Remote+Storage+Not+Ready+Exception

Re: [ANNOUNCE] Apache Kafka 3.7.0

Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew > > > > Schofield, Anna Sophie Blee-Goldman, Anton Agestam, Apoorv Mittal, > > > > Arnout Engelen, Arpit Goyal, Artem Livshits, Ashwin Pankaj, > > > > ashwinpankaj, atu-sharm, bachmanit

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

Hi Arpit, Thanks for the KIP! There is an open ticket [1] to generate the empty producer snapshot for segments which lacks one. Tiered storage is supported from IBP 2.8-IV1 which mandates that all the segments should have the producer snapshots. If we make the producer snapshot optional, then we

Re: [VOTE] KIP-956: Tiered Storage Quotas

+1 (non-binding), Thanks for the KIP, Abhijeet! -- Kamal On Fri, Mar 8, 2024 at 11:02 PM Jun Rao wrote: > Hi, Abhijeet, > > Thanks for the KIP. +1 > > Jun > > On Fri, Mar 8, 2024 at 3:44 AM Abhijeet Kumar > wrote: > > > Hi All, > > > > I would like to start the vote for KIP-956 - Tiered

Re: [DISCUSS] Minimum constraint for segment.ms

One use case I see for setting the `segment.bytes` to 1 is to delete all the records from the topic. We can mention about it in the doc to use the `kafka-delete-records` API instead. On Wed, Mar 13, 2024 at 6:59 PM Divij Vaidya wrote: > + users@kafka > > Hi users of Apache Kafka > > With the

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

Hi, Thanks for the KIP! Overall the KIP looks good and covered most of the items. 1. Could you explain how the brokers will handle the DisableRemoteTopic API request? 2. Who will initiate the controller interaction sequence? Does the controller listens for topic config updates and initiate the

Re: [DISCUSS] KIP-1021: Allow to get last stable offset (LSO) in kafka-get-offsets.sh

Hi Ahmed, Thanks for the KIP! It will be a useful addition to know the last-stable-offset (LSO) for a partition. Motivation section is not clear to me. Can you document the scenarios on how the exposed LSO can be used for txn support/debug? -- Kamal On Thu, Mar 21, 2024 at 11:30 PM Justine

Re: [DISCUSS] KIP-1018: Introduce max remote fetch timeout config

Hi all, Bumping the thread. Please review this KIP. Thanks! On Thu, Feb 1, 2024 at 9:11 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Hi Jorge, > > Thanks for the review! Added your suggestions to the KIP. PTAL. > > The `fetch.max.wait.ms` config wi

Re: [VOTE] KIP-1007: Introduce Remote Storage Not Ready Exception

n/java/org/apache/kafka/clients/consumer/internals/FetchCollector.java?L325 On Sun, Jan 7, 2024 at 5:36 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Thank you for all the votes! I'm closing the vote thread as it is open for > more than 72 hours. > The KIP h

Re: [DISCUSS] KIP-1007: Introduce Remote Storage Not Ready Exception

> exception is able to understand what it means. We can discuss that during > the PR review though. > > The KIP looks good to me. > > -- > Divij Vaidya > > > > On Fri, Jan 5, 2024 at 10:44 AM Satish Duggana > wrote: > > > Thanks for the KIP Kamal, LGTM. &

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

ired for topics migrated from < 2.8 > > version. This will not break the existing contract with the plugin. Yes, > > metrics do not make sense here as of now. > > Greg, @Kamal Chandraprakash WDYT ? > > Arpit Goyal > > 8861094754 > > > > > > On Sat, M

Re: [ANNOUNCE] New committer: Christo Lolov

Congrats Christo! On Tue, Mar 26, 2024, 17:42 Bruno Cadonna wrote: > Congrats, Christo! > > Well deserved! > > Best, > Bruno > > On 3/26/24 1:04 PM, Luke Chen wrote: > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer: > > Christo Lolov. > > > >

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

; Thanks. > Luke > > > On Wed, Apr 3, 2024 at 11:59 PM Arpit Goyal > wrote: > >> Thanks @Kamal Chandraprakash Greg >> Harris >> I currently do not have detailed understanding on the behaviour when empty >> producer snapshot restored. I will try to

Re: [ANNOUNCE] New Kafka PMC Member: Greg Harris

Congratulations, Greg! On Sun, Apr 14, 2024 at 8:57 AM Yash Mayya wrote: > Congrats Greg! > > On Sun, 14 Apr, 2024, 05:56 Randall Hauch, wrote: > > > Congratulations, Greg! > > > > On Sat, Apr 13, 2024 at 6:36 PM Luke Chen wrote: > > > > > Congrats, Greg! > > > > > > On Sun, Apr 14, 2024 at

Re: [ANNOUNCE] New committer: Igor Soarez

Congratulations, Igor! On Thu, Apr 25, 2024, 06:11 Luke Chen wrote: > Congrats, Igor! > > On Thu, Apr 25, 2024 at 6:10 AM Matthias J. Sax wrote: > > > Congrats! > > > > On 4/24/24 2:29 PM, Bill Bejeck wrote: > > > Congrats Igor! > > > > > > -Bill > > > > > > On Wed, Apr 24, 2024 at 2:37 PM Tom

[jira] [Commented] (KAFKA-4340) Change the default value of log.message.timestamp.difference.max.ms to the same as log.retention.ms

[ https://issues.apache.org/jira/browse/KAFKA-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607070#comment-15607070 ] Kamal Chandraprakash commented on KAFKA-4340: - Jiangjie Qin, I would like to work

[jira] [Assigned] (KAFKA-4750) KeyValueIterator returns null values

[ https://issues.apache.org/jira/browse/KAFKA-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Chandraprakash reassigned KAFKA-4750: --- Assignee: Kamal Chandraprakash > KeyValueIterator returns null val

  1   2   >