This can happen as a result of unclean leader elections - there are mbeans on the controller that give the unclean leader election rate - or you can check the controller logs to determine if this happened.
On Tue, Jan 27, 2015 at 09:54:38PM -0800, Liju John wrote: > Hi , > > I have query regarding partition offset . > > While running kafka cluster for some time ,I noticed that the partition > offset keeps on increasing and at some point the offset decreased by some > number . > In what scenarios does the offset of a topic partition reduces ? > > The problem I am facing is that my consumers are pulling the msgs from the > topic but at somepoint in time it throws exception that the current offset > is greater that the latest offset of the partition . > Is it because of retension the latest offset gets reset ? How can I handle > this scenarios > > Regards, > Liju John > S/W developer
