Re: Kafka consumer commit behaviour on rebalance

2018-02-13 Thread Manoj Khangaonkar
Yes. If a consumer when down, all the polled messages that were not committed will be redelivered to another consumer. regards On Tue, Feb 13, 2018 at 9:31 AM, pradeep s wrote: > Hi All, > I am running a Kafka consumer(Single threaded) on kubernetes . Application

Kafka consumer commit behaviour on rebalance

2018-02-13 Thread pradeep s
Hi All, I am running a Kafka consumer(Single threaded) on kubernetes . Application is polling the records and accummulating in memory . There is a scheduled write of these records to S3 . Only after that i am committing the offsets back to Kafka. There are 4 partitions and 4 consumers(4 kubernetes