Re: Kafka commit interval

2018-10-19 Thread pradeep s
Thanks Matthias On Fri, Oct 19, 2018 at 11:25 AM Matthias J. Sax wrote: > There is not upper limit. > > And yes, you are right about rebalancing. This would be an issue and > yes, you can use the rebalance listener to address it (it's the purpose > of the rebalance listener to be used for cases

Re: Kafka commit interval

2018-10-19 Thread Matthias J. Sax
There is not upper limit. And yes, you are right about rebalancing. This would be an issue and yes, you can use the rebalance listener to address it (it's the purpose of the rebalance listener to be used for cases like this). -Matthias On 10/16/18 2:19 PM, pradeep s wrote: > Hi, > I have a

Kafka commit interval

2018-10-16 Thread pradeep s
Hi, I have a usecase to stream messages from Kafka and buffer it in memory till a message count is reached and then write these to output file . I am using manual commit . I have a question on whats the maximum time i can wait after consuming the message and till we commit back to Kafka . Is there