Re: [VOTE] KIP-41: Consumer Max Records

2016-01-19 Thread Jason Gustafson
Hi All,

Looks like we have a total of +10, with +6 binding. Thanks to all who voted
and participated in the discussion!

-Jason

On Mon, Jan 18, 2016 at 2:35 PM, Jun Rao  wrote:

> Thanks for the proposal. +1.
>
> Jun
>
> On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson 
> wrote:
>
> > Hi All,
> >
> > I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> > configuration option "max.poll.records" which sets an upper bound on the
> > number of records returned in a call to poll(). This gives users a way to
> > limit message processing time to avoid unexpected rebalancing. This
> change
> > is backwards compatible with the default implementing the current
> behavior.
> >
> > Here's a link to the KIP wiki:
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
> >
> > Thanks,
> > Jason
> >
>


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-18 Thread Jun Rao
Thanks for the proposal. +1.

Jun

On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson  wrote:

> Hi All,
>
> I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> configuration option "max.poll.records" which sets an upper bound on the
> number of records returned in a call to poll(). This gives users a way to
> limit message processing time to avoid unexpected rebalancing. This change
> is backwards compatible with the default implementing the current behavior.
>
> Here's a link to the KIP wiki:
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
>
> Thanks,
> Jason
>


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-14 Thread Ismael Juma
+1 (non-binding)

On Thu, Jan 14, 2016 at 6:26 AM, Neha Narkhede  wrote:

> +1 (binding)
>
>
>
>
>
>
> On Wed, Jan 13, 2016 at 9:10 PM -0800, "Joel Koshy" 
> wrote:
>
>
>
>
>
>
>
>
>
>
> +1
>
> On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson  wrote:
>
> > Hi All,
> >
> > I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> > configuration option "max.poll.records" which sets an upper bound on the
> > number of records returned in a call to poll(). This gives users a way to
> > limit message processing time to avoid unexpected rebalancing. This
> change
> > is backwards compatible with the default implementing the current
> behavior.
> >
> > Here's a link to the KIP wiki:
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
> >
> > Thanks,
> > Jason
> >
>
>
>
>
>
>


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-14 Thread Jens Rantil
+1

On Thu, Jan 14, 2016 at 12:18 AM, Jason Gustafson 
wrote:

> Hi All,
>
> I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> configuration option "max.poll.records" which sets an upper bound on the
> number of records returned in a call to poll(). This gives users a way to
> limit message processing time to avoid unexpected rebalancing. This change
> is backwards compatible with the default implementing the current behavior.
>
> Here's a link to the KIP wiki:
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
>
> Thanks,
> Jason
>



-- 
Jens Rantil
Backend engineer
Tink AB

Email: jens.ran...@tink.se
Phone: +46 708 84 18 32
Web: www.tink.se

Facebook  Linkedin

 Twitter 


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-14 Thread Liquan Pei
+1

On Thu, Jan 14, 2016 at 2:05 AM, Jens Rantil  wrote:

> +1
>
> On Thu, Jan 14, 2016 at 12:18 AM, Jason Gustafson 
> wrote:
>
> > Hi All,
> >
> > I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> > configuration option "max.poll.records" which sets an upper bound on the
> > number of records returned in a call to poll(). This gives users a way to
> > limit message processing time to avoid unexpected rebalancing. This
> change
> > is backwards compatible with the default implementing the current
> behavior.
> >
> > Here's a link to the KIP wiki:
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
> >
> > Thanks,
> > Jason
> >
>
>
>
> --
> Jens Rantil
> Backend engineer
> Tink AB
>
> Email: jens.ran...@tink.se
> Phone: +46 708 84 18 32
> Web: www.tink.se
>
> Facebook  Linkedin
> <
> http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_photo=VSRPsearchId%3A1057023381369207406670%2CVSRPtargetId%3A2735919%2CVSRPcmpt%3Aprimary
> >
>  Twitter 
>



-- 
Liquan Pei
Department of Physics
University of Massachusetts Amherst


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-13 Thread Neha Narkhede
+1 (binding)






On Wed, Jan 13, 2016 at 9:10 PM -0800, "Joel Koshy"  wrote:










+1

On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson  wrote:

> Hi All,
>
> I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> configuration option "max.poll.records" which sets an upper bound on the
> number of records returned in a call to poll(). This gives users a way to
> limit message processing time to avoid unexpected rebalancing. This change
> is backwards compatible with the default implementing the current behavior.
>
> Here's a link to the KIP wiki:
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
>
> Thanks,
> Jason
>







Re: [VOTE] KIP-41: Consumer Max Records

2016-01-13 Thread Joel Koshy
+1

On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson  wrote:

> Hi All,
>
> I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> configuration option "max.poll.records" which sets an upper bound on the
> number of records returned in a call to poll(). This gives users a way to
> limit message processing time to avoid unexpected rebalancing. This change
> is backwards compatible with the default implementing the current behavior.
>
> Here's a link to the KIP wiki:
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
>
> Thanks,
> Jason
>


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-13 Thread Aarti Gupta
+1, this seems to be the best non intrusive option,  and allows us to
process a known amount of message on each poll. We can handle consumer
memory footprints in a separate KIP.

-Thanks
aarti

On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson  wrote:

> Hi All,
>
> I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> configuration option "max.poll.records" which sets an upper bound on the
> number of records returned in a call to poll(). This gives users a way to
> limit message processing time to avoid unexpected rebalancing. This change
> is backwards compatible with the default implementing the current behavior.
>
> Here's a link to the KIP wiki:
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
>
> Thanks,
> Jason
>


[VOTE] KIP-41: Consumer Max Records

2016-01-13 Thread Jason Gustafson
Hi All,

I'd like to open up the vote on KIP-41. This KIP adds a new consumer
configuration option "max.poll.records" which sets an upper bound on the
number of records returned in a call to poll(). This gives users a way to
limit message processing time to avoid unexpected rebalancing. This change
is backwards compatible with the default implementing the current behavior.

Here's a link to the KIP wiki:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records

Thanks,
Jason


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-13 Thread Gwen Shapira
Also, great job on the KIP, Jason.

I love the solution you found and I love how well you explained it in the
KIP.

On Wed, Jan 13, 2016 at 8:38 PM, Gwen Shapira  wrote:

> +1 (binding)
>
> On Wed, Jan 13, 2016 at 6:18 PM, Jason Gustafson 
> wrote:
>
>> Hi All,
>>
>> I'd like to open up the vote on KIP-41. This KIP adds a new consumer
>> configuration option "max.poll.records" which sets an upper bound on the
>> number of records returned in a call to poll(). This gives users a way to
>> limit message processing time to avoid unexpected rebalancing. This change
>> is backwards compatible with the default implementing the current
>> behavior.
>>
>> Here's a link to the KIP wiki:
>>
>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
>>
>> Thanks,
>> Jason
>>
>
>


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-13 Thread Guozhang Wang
+1.

On Wed, Jan 13, 2016 at 4:16 PM, Aarti Gupta  wrote:

> +1, this seems to be the best non intrusive option,  and allows us to
> process a known amount of message on each poll. We can handle consumer
> memory footprints in a separate KIP.
>
> -Thanks
> aarti
>
> On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson 
> wrote:
>
> > Hi All,
> >
> > I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> > configuration option "max.poll.records" which sets an upper bound on the
> > number of records returned in a call to poll(). This gives users a way to
> > limit message processing time to avoid unexpected rebalancing. This
> change
> > is backwards compatible with the default implementing the current
> behavior.
> >
> > Here's a link to the KIP wiki:
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
> >
> > Thanks,
> > Jason
> >
>



-- 
-- Guozhang


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-13 Thread Ewen Cheslack-Postava
+1 (binding)

-Ewen

On Wed, Jan 13, 2016 at 5:16 PM, Guozhang Wang  wrote:

> +1.
>
> On Wed, Jan 13, 2016 at 4:16 PM, Aarti Gupta 
> wrote:
>
> > +1, this seems to be the best non intrusive option,  and allows us to
> > process a known amount of message on each poll. We can handle consumer
> > memory footprints in a separate KIP.
> >
> > -Thanks
> > aarti
> >
> > On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson 
> > wrote:
> >
> > > Hi All,
> > >
> > > I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> > > configuration option "max.poll.records" which sets an upper bound on
> the
> > > number of records returned in a call to poll(). This gives users a way
> to
> > > limit message processing time to avoid unexpected rebalancing. This
> > change
> > > is backwards compatible with the default implementing the current
> > behavior.
> > >
> > > Here's a link to the KIP wiki:
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
> > >
> > > Thanks,
> > > Jason
> > >
> >
>
>
>
> --
> -- Guozhang
>



-- 
Thanks,
Ewen


Re: [VOTE] KIP-41: Consumer Max Records

2016-01-13 Thread Gwen Shapira
+1 (binding)

On Wed, Jan 13, 2016 at 6:18 PM, Jason Gustafson  wrote:

> Hi All,
>
> I'd like to open up the vote on KIP-41. This KIP adds a new consumer
> configuration option "max.poll.records" which sets an upper bound on the
> number of records returned in a call to poll(). This gives users a way to
> limit message processing time to avoid unexpected rebalancing. This change
> is backwards compatible with the default implementing the current behavior.
>
> Here's a link to the KIP wiki:
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
>
> Thanks,
> Jason
>