Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api

In my tests , I am using around 24 consumer groups. I never call consumer.close() or consumer.unsubscribe() until the application is shutting down. So the consumers never leave but new consumer instances do get created as the parallel requests pile up . Also, I am reusing consumer instances i

Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api

Is your test reusing a group name? And if so, are your consumer instances gracefully leaving? This may cause subsequent 'rebalance' operations to block until those old consumers check-in or the session timeout happens (30secs) -Dana On Jun 18, 2016 8:56 PM, "Rohit Sardesai" wrote: > I am using t

consumer.poll() takes approx. 30 seconds - 0.9 new consumer api

I am using the group management feature of Kafka 0.9 to handle partition assignment to consumer instances. I use the subscribe() API to subscribe to the topic I am interested in reading data from. I have an environment where I have 3 Kafka brokers with a couple of Zookeeper nodes . I created a

Re: test of producer's delay and consumer's delay

To Christian Posta , I have taken into account the interpretation of time. my producer and consumer are deployed on the same machine, the machine’s configuration is very good, so it will no

test+of+producer's+delay+and+consumer's+delay

I send every message with timestamp, and when I receive a message，I do a subtraction between current timestamp and message’s timestamp. then I get the consumer’s delay.