Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-28 Thread Gerard Klijs
riginal Message- > From: kant kodali [mailto:kanth...@gmail.com] > Sent: Friday, September 23, 2016 5:18 AM > To: users@kafka.apache.org > Subject: Re: why did Kafka choose pull instead of push for a consumer ? > > @Gerard > Here are my initial benchmarks > Producer on

RE: why did Kafka choose pull instead of push for a consumer ?

2016-09-23 Thread Tauzell, Dave
at once. If all the replicas fail around the same time you could lose data. -Dave -Original Message- From: kant kodali [mailto:kanth...@gmail.com] Sent: Friday, September 23, 2016 5:18 AM To: users@kafka.apache.org Subject: Re: why did Kafka choose pull instead of push for a consumer

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-23 Thread kant kodali
pace, slow consumers do not slow the > > > > > > > > complete > > > > > > > > system down. > > > > > > > > > > > >

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-23 Thread Gerard Klijs
> I'm only guessing here regarding if this is the reason: > > > > > > > > > > > > > > > > > > > > Pull is much more sensible when a lot of data is pushed through. It > > > allows > > > > &g

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-22 Thread kant kodali
gt; > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > Best regards, > > > > > > > > > > Rad > > > > > > > > > > >

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-22 Thread Gerard Klijs
> > > > > > > > On Sat, Sep 17, 2016 5:14 AM, Radoslaw Gruchalski ra...@gruchalski.com > > > > wrote: > > > > I'm only guessing here regarding if this is the reason: > > > > > > > > > > Pull is much more sensible when a lot of data is pushed through. It > allows > > > > consumers consuming at their own pace, slow consumers do not slow the > > > > complete > > > > system down. > > > > > > > > > > >

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-20 Thread Michael Freeman
> Rad > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Sat, Sep 17, 2016 at 11:18 AM +0200, "kant kodali" > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > why did Kafka choose pull instead of push for a consumer? push sounds like > > it > > > > > is more realtime to me than poll and also wouldn't poll just keeps polling > > even > > > > > when they are no messages in the broker causing more traffic? please > > enlighten > > > > > me

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-17 Thread Radoslaw Gruchalski
Best regards, Rad On Sat, Sep 17, 2016 at 11:18 AM +0200, "kant kodali" wrote: why did Kafka choose pull instead of push for a consumer? push sounds like it is more realtim

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-17 Thread Ofir Manor
ull is much more sensible when a lot of data is pushed through. It allows > > consumers consuming at their own pace, slow consumers do not slow the > > complete > > system down. > > > > > > > > > > > > > > -- > > > > > Best regards, >

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-17 Thread kant kodali
Best regards, Rad On Sat, Sep 17, 2016 at 11:18 AM +0200, "kant kodali" wrote: why did Kafka choose pull instead of push for a consumer? push sounds like it i

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-17 Thread Radoslaw Gruchalski
ough. It allows consumers consuming at their own pace, slow consumers do not slow the complete system down. -- Best regards, Rad On Sat, Sep 17, 2016 at 11:18 AM +0200, "kant kodali" wrote: why did Kafka choose pull instead of push for a con

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-17 Thread kant kodali
200, "kant kodali" wrote: why did Kafka choose pull instead of push for a consumer? push sounds like it is more realtime to me than poll and also wouldn't poll just keeps polling even when they are no messages in the broker causing more traffic? please enlighten me

Re: why did Kafka choose pull instead of push for a consumer ?

2016-09-17 Thread Radoslaw Gruchalski
"kant kodali" wrote: why did Kafka choose pull instead of push for a consumer? push sounds like it is more realtime to me than poll and also wouldn't poll just keeps polling even when they are no messages in the broker causing more traffic? please enlighten me

why did Kafka choose pull instead of push for a consumer ?

2016-09-17 Thread kant kodali
why did Kafka choose pull instead of push for a consumer? push sounds like it is more realtime to me than poll and also wouldn't poll just keeps polling even when they are no messages in the broker causing more traffic? please enlighten me