Re: Broker side partition round robin

ay 26, 2020 at 11:34 AM M. Manna wrote: > >> Hey Vinicius, >> >> >> On Tue, 26 May 2020 at 10:27, Vinicius Scheidegger < >> vinicius.scheideg...@gmail.com> wrote: >> >> > In a scenario with multiple independent producers (imagine ephemer

Broker side partition round robin

ays on the Producer. Is this understanding correct? If that's the case, how should one achieve an equally distributed load balancing (round robin) over the partitions in a scenario with multiple producers? Thank you, Vinicius Scheidegger

Re: Broker side partition round robin

t; synchronize all producers). > > Thank you, > > On Tue, May 26, 2020 at 1:41 PM Vinicius Scheidegger < > vinicius.scheideg...@gmail.com> wrote: > >> Yes, I checked it. The issue is that RoundRobbinPartitioner is bound to >> the producer. In a scenario with multiple

Re: Broker side partition round robin

as a Broker side round robin solution would. Am I missing something? Any other ideas? Thanks On Tue, May 26, 2020 at 11:34 AM M. Manna wrote: > Hey Vinicius, > > > On Tue, 26 May 2020 at 10:27, Vinicius Scheidegger < > vinicius.scheideg...@gmail.com> wrote: > > &g

Re: Broker side partition round robin

solution? Should I move this message to the dev forum? - no one gave me much attention there too (but maybe my messages are too big/boring - hahaha) Thanks On Tue, Jun 2, 2020 at 1:08 PM Vinicius Scheidegger < vinicius.scheideg...@gmail.com> wrote: > Hi Liam, > > First of all,

Re: Broker side partition round robin

o guarantee, but in my experience, > round robining multiple producers works fine. > > Cheers, > > Liam Clarke > > On Mon, 1 Jun. 2020, 11:55 pm Vinicius Scheidegger, < > vinicius.scheideg...@gmail.com> wrote: > > > Hey guys, I need some help here... > > &

Re: Kafka topic partition distributing evenly on disks

Hi Peter, AFAIK, everything depends on: 1) How you have configured your topic a) number of partitions (here I understand you have 15 partitions) b) partition replication configuration (each partition necessarily has a leader - primary responsible to hold the data - and for reads and writes)

Re: Keys and partitions

distribution might be good enough though. I hope it helps, Vinicius Scheidegger On Tue, Jul 7, 2020 at 7:52 AM Victoria Zuberman < victoria.zuber...@imperva.com> wrote: > Hi, > > I have userId as a key. > Many users have moderate amounts of data but some users have more and some

Re: On the best number of partitions per topic for kafka based application and the best number of consumers per topic?

(there are different partitioning schemes) and then you may have a better sense of it. I hope it helps Vinicius Scheidegger On Sat, Nov 14, 2020, 8:39 PM Mazen Ezzeddine < mazen.ezzedd...@etu.univ-cotedazur.fr> wrote: > Given a business application that resorts into a message queue solution > like

Re: On the best number of partitions per topic for kafka based application and the best number of consumers per topic?

sumer group is > doing to keep up with the production rate? > > On 2020/11/14 22:36:34, Vinicius Scheidegger < > vinicius.scheideg...@gmail.com> wrote: > > This depends on the design of your application and how you are using > Kafka. > > > > For instance,