Re: [DISCUSS] KIP-1010: Topic Partition Quota

Hi Afshin, We keep KIP discussions on d...@kafka.apache.org so please post this over there too. I'll go over this later this week but devs usually monitor that list more frequently and you'll have better chances of getting a reply there. Regards, Viktor On Wed, Jan 17, 2024 at 12:03 AM Afshin Mo

Re: [PROPOSAL] Add commercial support page on website

6 months or so does not cost much to the > community and if at the end it helps some users it is only a win IMHO. > > So overall my 2cts would be to try based on other projects model and if it > turns out Kafka is specific and it does not work for any reason, the page > can be dropped quite

Re: [PROPOSAL] Add commercial support page on website

Hi all, I think that making and updating such a list implies tricky questions that we have to deal with. Good examples were given by Matthias, that was my first thought as well before reading his response. On the other hand I think it would be a good alternative to create a list of companies that

Re: [ANNOUNCE] Apache Kafka 3.6.0

Thanks for the release Satish! :) On Wed, Oct 11, 2023, 09:30 Bruno Cadonna wrote: > Thanks for the release, Satish! > > Best, > Bruno > > On 10/11/23 8:29 AM, Luke Chen wrote: > > Thanks for running the release, Satish! > > > > BTW, 3.6.0 should be a major release, not a minor one. :) > > > > L

Re: [ANNOUNCE] New committer: Josep Prat

Congrats Josep! On Tue, Dec 20, 2022, 21:56 Matthias J. Sax wrote: > Congrats! > > On 12/20/22 12:01 PM, Josep Prat wrote: > > Thank you all! > > > > ——— > > Josep Prat > > > > Aiven Deutschland GmbH > > > > Immanuelkirchstraße 26, 10405 Berlin > > > > Amtsgericht Charlottenburg, HRB 209739 B >

Re: [ANNOUNCE] New committer: Viktor Somogyi-Vass

Congratulations, Viktor! > > > > > > Regards, > > > > > > Rajini > > > > > > > > > On Thu, Dec 15, 2022 at 11:41 AM Ron Dagostino > > wrote: > > > > > >> Congrats to you too, Victor! > > >> > > >&g

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Congrats Sophie! On Tue, Aug 2, 2022 at 8:51 AM Josep Prat wrote: > Congrats Sophie! > > On Tue, Aug 2, 2022 at 5:36 AM pengyh wrote: > > > > > congrats! > > > > > Congrats Sophie! 😄 > > > > > -- > [image: Aiven] > > *Josep Prat* > Open Source Engineering Manager, *Aiven*

Re: [ANNOUNCE] New Committer: Chris Egerton

Congrats Chris! On Mon, Jul 25, 2022, 18:33 Matthew Benedict de Detrich wrote: > Congratulations! > > -- > Matthew de Detrich > Aiven Deutschland GmbH > Immanuelkirchstraße 26, 10405 Berlin > Amtsgericht Charlottenburg, HRB 209739 B > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > m: +49

Re: [ANNOUNCE] New committer: Mickael Maison

Congrats Mickael!! :) On Fri, Nov 8, 2019 at 1:24 PM Satish Duggana wrote: > Congratulations Mickael!! > > On Fri, Nov 8, 2019 at 2:50 PM Rajini Sivaram > wrote: > > > > Congratulations, Mickael, well deserved!! > > > > Regards, > > > > Rajini > > > > On Fri, Nov 8, 2019 at 9:08 AM David Jacot

Re: [VOTE] 2.2.1 RC1

+1 (non-binding) 1. Ran unit tests 2. Ran some basic automatic end-to-end tests over plaintext and SSL too 3. Ran systests sanity checks Viktor On Thu, May 23, 2019 at 6:04 PM Harsha wrote: > +1 (binding) > > 1. Ran unit tests > 2. System tests > 3. 3 node cluster with few manual tests. > > Th

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

Congrats Matthias! On Tue, Apr 23, 2019 at 4:24 AM Becket Qin wrote: > Congrats, Matthias! > > On Sat, Apr 20, 2019 at 10:28 AM Matthias J. Sax > wrote: > > > Thank you all! > > > > -Matthias > > > > > > On 4/19/19 3:58 PM, Lei Chen wrote: > > > Congratulations Matthias! Well deserved! > > > >

Re: [ANNOUNCE] New Committer: Randall Hauch

Congrats Randall! :) On Fri, Feb 15, 2019 at 10:15 AM Satish Duggana wrote: > Congratulations Randall! > > On Fri, Feb 15, 2019 at 1:51 PM Mickael Maison > wrote: > > > > Congrats Randall! > > > > On Fri, Feb 15, 2019 at 6:37 AM James Cheng > wrote: > > > > > > Congrats, Randall! Well deserved

Re: [VOTE] 2.1.1 RC1

Hi, Ran the ducktapes but the streams upgrade tests failed because the dev version was not updated. This will be fixed in https://github.com/apache/kafka/pull/6217. Once it's merged I'll rerun them. Viktor On Wed, 30 Jan 2019, 22:19 Jonathan Santilli Hello, > > I have downloaded the source code

Re: [ANNOUNCE] New Committer: Manikumar Reddy

Congratulations Manikumar, well deserved! On Fri, 12 Oct 2018, 06:30 Andras Beni, wrote: > Congratulations, Manikumar! > > Srinivas Reddy ezt írta (időpont: 2018. okt. > 12., P 3:00): > > > Congratulations Mani. We'll deserved 👍 > > > > - > > Srinivas > > > > - Typed on tiny keys. pls ignore ty

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong! :) On Tue, Aug 21, 2018 at 10:09 AM James Cheng wrote: > Congrats Dong! > > -James > > > On Aug 20, 2018, at 3:54 AM, Ismael Juma wrote: > > > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the community and contributed

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

Congrats Dong! :) On Thu, Mar 29, 2018 at 2:12 PM, Satish Duggana wrote: > Congratulations Dong! > > > On Thu, Mar 29, 2018 at 5:12 PM, Sandor Murakozi > wrote: > > > Congrats, Dong! > > > > > > On Thu, Mar 29, 2018 at 2:15 AM, Dong Lin wrote: > > > > > Thanks everyone!! > > > > > > It is my g

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations! :) On Thu, Jan 18, 2018 at 10:38 AM, Rajini Sivaram wrote: > Thanks everyone! > > Regards, > > Rajini > > On Thu, Jan 18, 2018 at 8:53 AM, Damian Guy wrote: > > > Congratulations Rajini! > > > > On Thu, 18 Jan 2018 at 00:57 Hu Xi wrote: > > > > > Congratulations, Rajini Sivara

Re: Kafka in virtualized environments

red SAN storage with shared pools with > > > other > > > > VMs. So every time, there was some kind of considerable storage > > activity > > > > like DB backup or something, our zookeeper fsyncs used to take tens > of > > > > seconds causing

Kafka in virtualized environments

Hi folks, Recently I bumped into an interesting question: using kafka in virtualized environments, such as vmware. I'm not really familiar with virtualization in-depth (how disk virtualization works, what are the OS level supports etc.), therefore I think this is an interesting discussion from Kaf

Re: What are reasonable limits for max number of consumer groups per partition and per broker?

Hi Jeff, I think it's also worth considering that 1K consumer (implying that you have at least 1 consumer per group) for 1 partition means 1K TCP connection which means that they have to share the available bandwidth. Why do you have so many consumer groups? Do you basically want to multicast? Vi

Re: Kafka 0.9.0.1 partitions shrink and expand frequently after restart the broker

> --John > > On Thu, Nov 9, 2017 at 9:09 AM, Viktor Somogyi > wrote: > > > Hi Json. > > > > John might have a point. It is not reasonable to have more than 6-8GB of > > heap provided for the JVM that's running Kafka. One of the reason is GC > > tim

Re: Kafka 0.9.0.1 partitions shrink and expand frequently after restart the broker

Hi Json. John might have a point. It is not reasonable to have more than 6-8GB of heap provided for the JVM that's running Kafka. One of the reason is GC time and the other is that Kafka relies heavily on the OS' disk read/write in-memory caching. Also there were a few synchronization bugs in 0.9

Re: Metrics for Kafka Connect

Hi Jeff, There is a KIP going on, would this answer your question? https://cwiki.apache.org/confluence/display/KAFKA/KIP-196%3A+Add+metrics+to+Kafka+Connect+framework Viktor On Tue, Sep 12, 2017 at 2:38 PM, Jeff Klukas wrote: > The Kafka docs on Monitoring don't mention anything specific for K

Re: Reduce Kafka Client logging

Hi Raghav, I think it is enough to raise the logging level of org.apache.kafka.clients.producer.ProducerConfig to WARN in log4j. Also I'd like to mention that if possible, don't recreate the Kafka producer each time. The protocol is designed for long-living connections and recreating the connectio

Re: Shooting for microsecond latency between a Kafka producer and a Kafka consumer

Hi Chao, Apart from the actual request, the consumer sends metadata requests as well. What is actually going through the network when you get these latencies? Try increasing the metadata max age with metadata.max.age.ms. (Disclaimer: I myself never ran any benchmarking, just trying to help :). )

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

administers to think of ACLs in terms of whether the user is allowed to > write (Produce) or > read (Consume) messages and not the lower level semantics that are that > consuming is actually > reading AND writing (albeit only to the offset topic). > > -hans > > >

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

Hi Vahid, +1 for OffsetFetch from me too. I also wanted to ask the strangeness of the permissions, like why is OffsetCommit a Read operation instead of Write which would intuitively make more sense to me. Perhaps any expert could shed some light on this? :) Viktor On Tue, Jun 13, 2017 at 2:38 P