Re: KafkaConsumer.poll(long) pauses indefinitely

2016-02-11 Thread Jason Gustafson
See https://issues.apache.org/jira/browse/KAFKA-1894.

-Jason

On Wed, Feb 10, 2016 at 2:08 PM, William Grim  wrote:

> Hi,
>
> I'm noticing that when we have a thread that comes up and calls
> KafkaConsumer.poll(long), it will pause for a much longer time than our 1s
> timeout.  It looks like this is probably happening when kafka gets down to
> calling ConsumerNetworkClient.epollWait after calling
> ConsumerNetworkClient.poll(Future), because that API seems to pass
> Long.MAX_VALUE as the timeout to the low-level libs.
>
> So, my question is if this is a known bug?  I couldn't find anything about
> it, but it seems like if I start generating random traffic to that topic,
> the timeout resolves sooner but not much sooner than now.
>
> Thanks!
>
> --
>
>
>
>
> *William GrimSr. Software Engineerm: 914 418 4115
> <914%20418%204115>e: wg...@signal.co signal.co
> <
> http://www.google.com/url?q=http%3A%2F%2Fsignal.co%2F=D=1=AFrqEzf9BbOBbhu7G5O2liTp3wXdU2t6FA
> >Cut
> Through the NoiseThis e-mail and any files transmitted with it are for the
> sole use of the intended recipient(s) and may contain confidential and
> privileged information. Any unauthorized use of this email is strictly
> prohibited. ©2015 Signal. All rights reserved.*
>


KafkaConsumer.poll(long) pauses indefinitely

2016-02-10 Thread William Grim
Hi,

I'm noticing that when we have a thread that comes up and calls
KafkaConsumer.poll(long), it will pause for a much longer time than our 1s
timeout.  It looks like this is probably happening when kafka gets down to
calling ConsumerNetworkClient.epollWait after calling
ConsumerNetworkClient.poll(Future), because that API seems to pass
Long.MAX_VALUE as the timeout to the low-level libs.

So, my question is if this is a known bug?  I couldn't find anything about
it, but it seems like if I start generating random traffic to that topic,
the timeout resolves sooner but not much sooner than now.

Thanks!

-- 




*William GrimSr. Software Engineerm: 914 418 4115
<914%20418%204115>e: wg...@signal.co signal.co
Cut
Through the NoiseThis e-mail and any files transmitted with it are for the
sole use of the intended recipient(s) and may contain confidential and
privileged information. Any unauthorized use of this email is strictly
prohibited. ©2015 Signal. All rights reserved.*