Hi All,

I have come across the case where my client will return a 0 size list from
poll after an extended period of time of working properly. There is 100%
new data being added to the topic when poll starts returning nothing. I am
hoping someone might have some insight as to why this happens. About the
issue:
* this is on a per consumer group. A group will go bad, but others will be
fine.
* I am using the auto commit feature to manage offset commits.
* restarting the client will temporarily fix the issue. It will consumer
100,000's of messages and then stop after an extended period of time.
* Seeking to the beginning or end of the topic's queues fixes this often,
but not always and has become less reliable for me lately.
* the cluster size is 18 kafka nodes, 180 partitions per topic, 3
zookeepers. and we are using the kafka offset manager.
* __consumer_offsets is 50 partitions/default

Any help would be greatly appreciated!

Thanks,
Zach

Reply via email to